00000001:02000400:3.0F:1787135688.573759:0:2958:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787135706.931263:0:3177:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787135709.578301:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 287 MB/s 00000001:01000000:3.0:1787135709.837405:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 645 MB/s 00000001:01000000:1.0F:1787135710.087156:0:3221:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 8167 MB/s 00000020:02000000:0.0F:1787135711.043751:0:3270:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.57_8_gdef02f8 00000400:02000000:3.0:1787135712.315112:0:3284:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.138@tcp [8/256/0/180] 00008000:02000000:2.0:1787135716.808932:0:3433:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787135765.185714:0:5234:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787135776.754896:0:5802:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787135776.754901:0:5802:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787135776.755788:0:5802:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000008f167eca 00000080:02000400:0.0:1787135776.755801:0:5802:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1787135776.767782:0:5802:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1787135776.767794:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787135776.768379:0:5802:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000fe968b32) 00000020:00000080:1.0:1787135776.768402:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787135776.808582:0:5802:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1787135776.809763:0:5802:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787135776.862012:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787135776.862132:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787135776.862157:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787135776.862462:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787135776.862491:0:5802:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787135776.862894:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787135776.862902:0:5802:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787135776.862913:0:5802:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f202099 00000020:01000004:3.0:1787135776.862920:0:5802:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787135776.862925:0:5802:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787135776.862930:0:5802:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008f167eca from MGS 00000020:01000004:3.0:1787135776.862934:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787135776.862955:0:5802:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000637a1d93) 00000020:00000080:3.0:1787135776.862969:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787135776.863090:0:5802:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008f167eca from MGS, refs=2 00080000:01000000:3.0:1787135776.863095:0:5802:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787135776.863100:0:5802:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f2020a7 00000100:00100000:3.0:1787135776.863448:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787135776.863589:0:5802:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787135776.863595:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787135776.864490:0:5802:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787135776.864498:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1787135776.865728:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787135776.865973:0:5802:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1787135776.865979:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1787135776.866886:0:5802:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1787135776.866894:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787135776.870412:0:5802:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787135776.870502:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787135776.871543:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135776.871548:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135776.871549:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135776.871939:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135776.871941:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135776.871942:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135776.872724:0:5802:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787135776.881509:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787135777.124451:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1876 MB/s 00000001:01000000:2.0:1787135777.383270:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2305 MB/s 00000001:01000000:2.0:1787135777.635171:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 357 MB/s 00010000:00010000:1.0:1787135777.880886:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787135777.888754:0:5802:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 387 MB/s 00080000:10000000:2.0:1787135777.911696:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:0.0:1787135777.935199:0:5802:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787135777.935225:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787135777.935228:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787135777.938182:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787135777.938637:0:5802:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787135777.938704:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1787135777.938927:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787135777.938967:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787135777.939832:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787135777.939985:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787135777.941117:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787135777.956616:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787135777.967604:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787135777.986602:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787135777.986622:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787135778.001287:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787135778.001325:0:5802:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.138@tcp' 00000020:01000004:3.0:1787135778.001327:0:5802:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787135778.001399:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.138@tcp (typ=mgc) 00000020:00000080:3.0:1787135778.001411:0:5802:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.138@tcp (00000000d76f3549) 00000020:00000080:3.0:1787135778.001425:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787135778.001509:0:5802:0:(ldlm_lib.c:103:import_set_conn()) imp 00000000ad51bf6b@MGC192.168.203.138@tcp: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1787135778.001685:0:5802:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.138@tcp-0 is initialized 00000040:01000000:3.0:1787135778.001691:0:5802:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787135778.001947:0:5817:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787135778.010222:0:5818:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787135778.016718:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.138@tcp (uuid e67bffa2-3749-4eab-9303-62ad12948de4) 00000020:00000080:2.0:1787135778.021185:0:5802:0:(genops.c:1406:class_connect()) connect: client e67bffa2-3749-4eab-9303-62ad12948de4, cookie 0xf5850c552f2020b5 00000100:00080000:2.0:1787135778.021203:0:5802:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787135778.021208:0:5802:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import 00000000ad51bf6b using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1787135778.021263:0:5802:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009917ac12 x1873947616346240/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787135778.021463:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009917ac12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e67bffa2-3749-4eab-9303-62ad12948de4:3299:1873947616346240:0@lo:250: 00000100:00100000:0.0:1787135778.021561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787135778.021767:0:5802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e67bffa2-3749-4eab-9303-62ad12948de4->MGS 00000020:01000004:2.0:1787135778.021788:0:5802:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787135778.021795:0:5802:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787135778.021814:0:5802:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a1f45093) 00000020:00000080:2.0:1787135778.021830:0:5802:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1787135778.030170:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616346240 00000100:00100000:1.0:1787135778.030187:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616346240 00000100:00100000:1.0:1787135778.030235:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787135778.030243:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d52ca66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1873947616346240:12345-0@lo:250: 00010000:00080000:1.0:1787135778.030269:0:5813:0:(ldlm_lib.c:1449:target_handle_connect()) MGS: connection from e67bffa2-3749-4eab-9303-62ad12948de4@0@lo t0 exp 0000000000000000 cur 137 last 0 00000020:00000080:1.0:1787135778.030317:0:5813:0:(genops.c:1406:class_connect()) connect: client e67bffa2-3749-4eab-9303-62ad12948de4, cookie 0xf5850c552f2020c3 00000100:00080000:1.0:1787135778.030456:0:5813:0:(import.c:65:import_set_state_nolock()) 00000000a1dc2807 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787135778.036661:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d52ca66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+5:3299:x1873947616346240:12345-0@lo:250: Request processed in 6409us (15092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135778.036687:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787135778.039590:0:3299:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787135778.039605:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.138@tcp: connect to target with instance 0 00000100:00080000:0.0:1787135778.039613:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787135778.039618:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787135778.039622:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000ad51bf6b MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787135778.039626:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787135778.039638:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787135778.039645:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009917ac12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e67bffa2-3749-4eab-9303-62ad12948de4:3299:1873947616346240:0@lo:250: 00000100:00100000:0.0:1787135778.051583:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787135778.051793:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787135778.051800:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787135778.053668:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787135778.053681:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787135778.059237:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787135778.059259:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787135778.068746:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787135778.068946:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787135778.068952:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787135778.070792:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787135778.070804:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1787135778.101276:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787135778.101569:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1787135778.101576:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787135778.102704:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787135778.102714:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787135778.103325:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787135778.103491:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787135778.103496:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787135778.104007:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787135778.104014:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787135778.104702:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787135778.104829:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787135778.104833:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787135778.105387:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787135778.105394:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787135778.105962:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787135778.106298:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787135778.106304:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787135778.106873:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787135778.106880:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1787135778.132656:0:5802:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787135778.133218:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787135778.133225:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787135778.135612:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787135778.135625:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787135778.137219:0:5802:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787135778.137231:0:5802:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787135778.138181:0:5802:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787135778.138206:0:5802:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787135778.138213:0:5802:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787135778.138331:0:5802:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787135778.138363:0:5802:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1787135778.138439:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787135778.138441:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787135778.138442:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787135778.138443:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787135778.138444:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787135778.138446:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787135778.138447:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787135778.138448:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787135778.138449:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787135778.138450:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787135778.138452:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787135778.138453:0:5802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787135778.138456:0:5802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1787135778.138458:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787135778.138460:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787135778.138461:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787135778.138462:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787135778.138463:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787135778.138464:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787135778.138465:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787135778.138466:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787135778.138467:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787135778.138468:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787135778.138469:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787135778.138469:0:5802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787135778.138505:0:5802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787135778.138522:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e33cbd65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616346368:0@lo:253: 00000100:00100000:0.0:1787135778.138666:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135778.138727:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 0000000043032c50 going to sleep for 11 seconds 00000100:00100000:1.0:1787135778.138828:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616346368 00000100:00100000:1.0:1787135778.138836:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616346368 00000100:00100000:1.0:1787135778.138881:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787135778.138889:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000004c1d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+5:5802:x1873947616346368:12345-0@lo:253: 20000000:01000000:1.0:1787135778.138935:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787135778.138938:0:5816:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787135778.139500:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787135778.139574:0:5816:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1787135778.139833:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787135778.140779:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1787135778.141100:0:5816:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787135778.141105:0:5816:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1787135778.141110:0:5816:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1787135778.141114:0:5816:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1787135778.141128:0:5816:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1787135778.141294:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787135778.141533:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1787135778.141558:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1787135778.141610:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1787135778.141667:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1787135778.141723:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1787135778.141816:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1787135778.141825:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1787135778.141868:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1787135778.141876:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1787135778.141910:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1787135778.141918:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1787135778.141948:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1787135778.141988:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1787135778.142014:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787135778.142018:0:5816:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1787135778.142031:0:5816:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787135778.142273:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1787135778.142283:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1787135778.142317:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1787135778.142351:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1787135778.142409:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1787135778.142422:0:5816:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1787135778.142495:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1787135778.142503:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1787135778.142559:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1787135778.142607:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1787135778.142640:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1787135778.142649:0:5816:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1787135778.142724:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1787135778.142734:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1787135778.142767:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1787135778.142822:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1787135778.142982:0:5816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1787135778.143027:0:5816:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1787135778.143033:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787135778.144591:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787135778.144893:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787135778.144917:0:5816:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.138@tcp for mdt 20000000:01000000:1.0:1787135778.144919:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:1.0:1787135778.144956:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787135778.144963:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787135778.145178:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787135778.145188:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:1.0:1787135778.145255:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787135778.145267:0:5816:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787135778.145299:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787135778.145334:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787135778.145482:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787135778.145486:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787135778.145491:0:5816:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787135778.145504:0:5816:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787135778.149652:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1787135778.149948:0:5816:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1787135778.161638:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787135778.161686:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1787135778.161769:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1787135778.161797:0:5816:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787135778.161800:0:5816:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787135778.161804:0:5816:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787135778.161815:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787135778.161817:0:5816:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787135778.161845:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787135778.161848:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787135778.162454:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1787135778.162680:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1787135778.162712:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1787135778.162760:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1787135778.162771:0:5816:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787135778.162773:0:5816:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787135778.163885:0:5842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1787135778.164362:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1787135778.164423:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1787135778.164454:0:5816:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1787135778.164465:0:5816:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787135778.164467:0:5816:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1787135778.164473:0:5816:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787135778.164491:0:5816:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.164506:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020ca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.164514:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.164519:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.164532:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020ca lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.164538:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.164545:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e0ee6722 already unused, calling callback (00000000ca6499d4) 00010000:00010000:1.0:1787135778.164561:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.164569:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.164580:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020ca lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.164586:0:5816:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.164591:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020ca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787135778.164608:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787135778.431917:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000004c1d0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+5:5802:x1873947616346368:12345-0@lo:253: Request processed in 293021us (293244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135778.431937:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787135778.433094:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e33cbd65 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616346368:0@lo:253: 10000000:01000000:3.0:1787135778.433159:0:5802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787135778.433176:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787135778.433178:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787135778.433179:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787135778.433180:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787135778.433181:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787135778.433182:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787135778.433183:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787135778.433184:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787135778.433186:0:5802:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787135778.433187:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787135778.433188:0:5802:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787135778.433489:0:5802:0:(tgt_mount.c:101:server_register_mount()) register mount 000000008f167eca from lustre-MDT0000 10000000:01000000:3.0:1787135778.433515:0:5802:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787135778.433518:0:5802:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787135778.433522:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e9860760000 10000000:01000000:3.0:1787135778.433526:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787135778.433534:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8e9860760000 from 1 10000000:01000000:3.0:1787135778.433536:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787135778.433672:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000004b81790e/0xf5850c552f2020d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135778.433683:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000004b81790e/0xf5850c552f2020d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135778.433691:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000004b81790e/0xf5850c552f2020d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135778.433708:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004734cf1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616346496:0@lo:101: 00000100:00100000:3.0:1787135778.433771:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135778.433955:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000df1f7e52 going to sleep for 11 seconds 00000100:00100000:1.0:1787135778.434151:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616346496 00000100:00100000:1.0:1787135778.434159:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616346496 00000100:00100000:1.0:1787135778.434475:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787135778.434484:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022266166 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+5:5802:x1873947616346496:12345-0@lo:101: 00010000:00010000:1.0:1787135778.434496:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135778.434510:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2020d1 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.434540:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2020d1 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.434570:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e0ee6722/0xf5850c552f2020d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2020d1 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135778.434579:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e0ee6722, rc 0) 00000100:00100000:1.0:1787135778.434630:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022266166 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+6:5802:x1873947616346496:12345-0@lo:101: Request processed in 148us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135778.434636:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787135778.434708:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004734cf1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616346496:0@lo:101: 00010000:00010000:0.0:1787135778.434722:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000004b81790e/0xf5850c552f2020d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2020d8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135778.434729:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000004b81790e/0xf5850c552f2020d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2020d8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135778.434786:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087c17698 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616346624:0@lo:501: 00000100:00100000:0.0:1787135778.434820:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135778.435200:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b70c79b7 going to sleep for 11 seconds 00000100:00100000:3.0:1787135778.435561:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616346624 00000100:00100000:3.0:1787135778.435568:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616346624 00000100:00100000:3.0:1787135778.435595:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787135778.435601:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002ac5da9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+6:5802:x1873947616346624:12345-0@lo:501: 00000100:00100000:3.0:1787135778.435866:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002ac5da9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+6:5802:x1873947616346624:12345-0@lo:501: Request processed in 264us (1045us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787135778.435874:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787135778.436017:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087c17698 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616346624:0@lo:501: 10000000:01000000:0.0:1787135778.436042:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787135778.436072:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000004b81790e/0xf5850c552f2020d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2020d8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135778.436081:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000004b81790e/0xf5850c552f2020d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2020d8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135778.436097:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e98456a5800 10000000:01000000:0.0:1787135778.436113:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787135778.436118:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e98456a5800 10000000:01000000:0.0:1787135778.436121:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1787135778.436123:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8e98456a5800 from 1 10000000:01000000:0.0:1787135778.436125:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1787135778.436150:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000003418678e/0xf5850c552f2020df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135778.436157:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000003418678e/0xf5850c552f2020df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135778.436165:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000003418678e/0xf5850c552f2020df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135778.436178:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087c17698 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616346752:0@lo:101: 00000100:00100000:0.0:1787135778.436218:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135778.436250:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b70c79b7 going to sleep for 11 seconds 00000100:00100000:3.0:1787135778.436577:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616346752 00000100:00100000:3.0:1787135778.436583:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616346752 00000100:00100000:3.0:1787135778.436604:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787135778.436610:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009767a76d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+6:5802:x1873947616346752:12345-0@lo:101: 00010000:00010000:3.0:1787135778.436620:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135778.436633:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006d36116d/0xf5850c552f2020e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2020df expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135778.436652:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006d36116d/0xf5850c552f2020e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2020df expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135778.436660:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006d36116d/0xf5850c552f2020e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2020df expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135778.436667:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006d36116d, rc 0) 00000100:00100000:3.0:1787135778.436706:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009767a76d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+7:5802:x1873947616346752:12345-0@lo:101: Request processed in 97us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135778.436712:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787135778.436796:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087c17698 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616346752:0@lo:101: 00010000:00010000:0.0:1787135778.436808:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000003418678e/0xf5850c552f2020df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135778.436814:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000003418678e/0xf5850c552f2020df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135778.436825:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787135778.436833:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000003418678e/0xf5850c552f2020df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135778.436851:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000003418678e/0xf5850c552f2020df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135778.436857:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787135778.436869:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787135778.436874:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e98456a5800 10000000:01000000:0.0:1787135778.436876:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787135778.436878:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787135778.436880:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787135778.436894:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000063731f8/0xf5850c552f2020ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135778.436901:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000063731f8/0xf5850c552f2020ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135778.436907:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000063731f8/0xf5850c552f2020ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135778.436918:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087c17698 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616346880:0@lo:101: 00000100:00100000:0.0:1787135778.436942:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135778.436973:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b70c79b7 going to sleep for 11 seconds 00000100:00100000:3.0:1787135778.437085:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616346880 00000100:00100000:3.0:1787135778.437091:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616346880 00000100:00100000:3.0:1787135778.437109:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787135778.437114:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e4e031b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+7:5802:x1873947616346880:12345-0@lo:101: 00010000:00010000:3.0:1787135778.437121:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135778.437128:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc21fae9/0xf5850c552f2020f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2020ed expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135778.437150:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc21fae9/0xf5850c552f2020f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2020ed expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135778.437156:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc21fae9/0xf5850c552f2020f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2020ed expref: 8 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135778.437161:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc21fae9, rc 0) 00000100:00100000:3.0:1787135778.437195:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e4e031b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+8:5802:x1873947616346880:12345-0@lo:101: Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135778.437201:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787135778.437629:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087c17698 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616346880:0@lo:101: 00010000:00010000:0.0:1787135778.437642:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000063731f8/0xf5850c552f2020ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2020f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135778.437650:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000063731f8/0xf5850c552f2020ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2020f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135778.437706:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087c17698 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616347008:0@lo:501: 00000100:00100000:0.0:1787135778.437732:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135778.437750:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b70c79b7 going to sleep for 11 seconds 00000100:00100000:3.0:1787135778.437878:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616347008 00000100:00100000:3.0:1787135778.437883:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616347008 00000100:00100000:3.0:1787135778.437914:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787135778.437921:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d664d01b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+8:5802:x1873947616347008:12345-0@lo:501: 00000100:00100000:3.0:1787135778.438159:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d664d01b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+9:5802:x1873947616347008:12345-0@lo:501: Request processed in 239us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135778.438167:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787135778.439095:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087c17698 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616347008:0@lo:501: 00000100:00100000:0.0:1787135778.439135:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087c17698 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616347136:0@lo:503: 00000100:00100000:0.0:1787135778.439185:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135778.439510:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b70c79b7 going to sleep for 11 seconds 00000100:00100000:3.0:1787135778.439581:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616347136 00000100:00100000:3.0:1787135778.439588:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616347136 00000100:00100000:3.0:1787135778.439668:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787135778.439677:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000040edb3a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+9:5802:x1873947616347136:12345-0@lo:503: 00000100:00100000:3.0:1787135778.439871:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000040edb3a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+9:5802:x1873947616347136:12345-0@lo:503: Request processed in 196us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135778.439879:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787135778.440012:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087c17698 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616347136:0@lo:503: 00000100:00100000:1.0:1787135778.448887:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000080f3d93e pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:5845:1873947616347264:0@lo:502: 00000100:00100000:1.0:1787135778.448970:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135778.449102:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set 00000000027c63bb going to sleep for 11 seconds 00000100:00100000:0.0:1787135778.449534:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616347264 00000100:00100000:0.0:1787135778.449542:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616347264 00000100:00100000:0.0:1787135778.449658:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787135778.449666:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004363b34d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+9:5845:x1873947616347264:12345-0@lo:502: 00000100:00100000:0.0:1787135778.449908:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004363b34d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+9:5845:x1873947616347264:12345-0@lo:502: Request processed in 242us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135778.449915:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787135778.450004:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000080f3d93e pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:5845:1873947616347264:0@lo:502: 00000020:01000000:1.0:1787135778.450034:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787135778.450045:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787135778.450064:0:5845:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787135778.450069:0:5845:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787135778.450072:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787135778.450086:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000b815b45f) 00000020:00000080:1.0:1787135778.450102:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787135778.450107:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787135778.450174:0:5845:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787135778.450180:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f202102 00000020:00000080:1.0:1787135778.450794:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787135778.450801:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787135778.450806:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787135778.450807:0:5845:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787135778.450818:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787135778.450822:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787135778.450823:0:5845:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787135778.450826:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787135778.450834:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000002435f4bb) 00000020:00000080:1.0:1787135778.450845:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787135778.450849:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787135778.450850:0:5845:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787135778.450853:0:5845:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787135778.450857:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787135778.450900:0:5845:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008f167eca from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787135778.450912:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d2848004) 00000020:00000080:1.0:1787135778.450918:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787135778.450976:0:5845:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787135778.450981:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5850c552f202117 00000020:00000080:1.0:1787135778.451100:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787135778.451106:0:5845:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787135778.451110:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf5850c552f20211e 00080000:01000000:1.0:1787135778.451114:0:5845:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787135778.451117:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f202125 00080000:10000000:1.0:1787135778.451747:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787135778.452002:0:5845:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787135778.459643:0:5845:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787135778.613670:0:5845:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787135778.613972:0:5845:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787135778.623457:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787135778.623740:0:5845:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787135778.702639:0:5845:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009f53604e) 00000020:00000080:2.0:1787135778.702660:0:5845:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787135778.702737:0:5845:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787135778.702743:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f202133 00000020:00000080:1.0:1787135778.703314:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1787135778.705178:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787135778.768631:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787135778.828523:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:0.0:1787135778.909995:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1787135778.924829:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787135779.028462:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787135779.064220:0:5845:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1787135779.182587:0:5845:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf5850c552f20213a 00000020:00000080:0.0:1787135779.184012:0:5845:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1787135779.184026:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787135779.184034:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135779.184036:0:5845:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1787135779.184040:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787135779.184079:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135779.184081:0:5845:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1787135779.184086:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1787135779.184133:0:5845:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1787135779.184161:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787135779.184165:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135779.184166:0:5845:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1787135779.184168:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787135779.184171:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135779.184172:0:5845:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787135779.184175:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787135779.184176:0:5845:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787135779.184244:0:5845:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087c17698 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:5845:1873947616347392:0@lo:502: 00000100:00100000:0.0:1787135779.184902:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135779.185017:0:5845:0:(client.c:2702:ptlrpc_set_wait()) set 000000002dfc5f59 going to sleep for 11 seconds 00000100:00100000:2.0:1787135779.191181:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616347392 00000100:00100000:2.0:1787135779.191196:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616347392 00000100:00100000:2.0:1787135779.191897:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787135779.191908:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000045eebc92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+9:5845:x1873947616347392:12345-0@lo:502: 00000100:00100000:3.0:1787135779.193585:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000045eebc92 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+9:5845:x1873947616347392:12345-0@lo:502: Request processed in 1674us (8806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135779.193614:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787135779.193759:0:5845:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087c17698 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:5845:1873947616347392:0@lo:502: 00000020:01000000:0.0:1787135779.193794:0:5845:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787135779.193801:0:5845:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135779.193803:0:5845:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787135779.193807:0:5845:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787135779.193970:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787135779.193987:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787135779.194005:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000063731f8/0xf5850c552f2020ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2020f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135779.194016:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000063731f8/0xf5850c552f2020ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2020f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787135779.194023:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e98456a5800 from 1 10000000:01000000:3.0:1787135779.194026:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787135779.194080:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135779.194088:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135779.194096:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135779.194112:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000052c2415a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616347520:0@lo:101: 00000100:00100000:3.0:1787135779.194148:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135779.194200:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afc353f8 going to sleep for 11 seconds 00000100:00100000:1.0:1787135779.194265:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616347520 00000100:00100000:1.0:1787135779.194272:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616347520 00000100:00100000:1.0:1787135779.194314:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787135779.194321:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008074eaa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+9:5802:x1873947616347520:12345-0@lo:101: 00010000:00010000:1.0:1787135779.194333:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135779.194352:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff76dc79/0xf5850c552f202148 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202141 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135779.194373:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff76dc79/0xf5850c552f202148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202141 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135779.194383:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff76dc79/0xf5850c552f202148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202141 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135779.194391:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff76dc79, rc 0) 00000100:00100000:1.0:1787135779.194430:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008074eaa9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+10:5802:x1873947616347520:12345-0@lo:101: Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135779.194436:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787135779.194549:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000052c2415a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616347520:0@lo:101: 00010000:00010000:3.0:1787135779.194561:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202148 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135779.194569:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202148 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135779.195159:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000052c2415a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616347648:0@lo:256: 00000100:00100000:3.0:1787135779.195201:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135779.195220:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afc353f8 going to sleep for 11 seconds 00000100:00100000:0.0:1787135779.196120:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616347648 00000100:00100000:0.0:1787135779.196131:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616347648 00000100:00100000:0.0:1787135779.196175:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787135779.196182:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000005abcd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+10:5802:x1873947616347648:12345-0@lo:256: 20000000:01000000:0.0:1787135779.196201:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787135779.196206:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787135779.196301:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000005abcd1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+10:5802:x1873947616347648:12345-0@lo:256: Request processed in 119us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135779.196308:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787135779.197178:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000052c2415a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616347648:0@lo:256: 10000000:01000000:3.0:1787135779.197891:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787135779.197914:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202148 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135779.197926:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202148 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787135779.197936:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e98456a5800 from 1 10000000:01000000:3.0:1787135779.197939:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787135779.197979:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135779.197986:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135779.197995:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135779.198024:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000052c2415a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616347776:0@lo:101: 00000100:00100000:3.0:1787135779.198113:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135779.198151:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afc353f8 going to sleep for 11 seconds 00000100:00100000:1.0:1787135779.198404:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616347776 00000100:00100000:1.0:1787135779.198412:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616347776 00000100:00100000:1.0:1787135779.198462:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787135779.198468:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000036217318 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+10:5802:x1873947616347776:12345-0@lo:101: 00010000:00010000:1.0:1787135779.198481:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135779.198884:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000077460dc4/0xf5850c552f202156 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20214f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135779.198912:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000077460dc4/0xf5850c552f202156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20214f expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135779.198921:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000077460dc4/0xf5850c552f202156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20214f expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135779.198930:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000077460dc4, rc 0) 00000100:00100000:1.0:1787135779.198993:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000036217318 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+11:5802:x1873947616347776:12345-0@lo:101: Request processed in 524us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135779.199013:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787135779.209457:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000052c2415a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616347776:0@lo:101: 00010000:00010000:3.0:1787135779.209486:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202156 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135779.209514:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202156 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135779.209602:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000052c2415a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616347904:0@lo:501: 00000100:00100000:3.0:1787135779.209667:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135779.209722:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000afc353f8 going to sleep for 11 seconds 00000100:00100000:1.0:1787135779.209793:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616347904 00000100:00100000:1.0:1787135779.209800:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616347904 00000100:00100000:1.0:1787135779.209846:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787135779.209854:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ccda2294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+11:5802:x1873947616347904:12345-0@lo:501: 00000100:00100000:1.0:1787135779.210636:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ccda2294 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+11:5802:x1873947616347904:12345-0@lo:501: Request processed in 781us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135779.210646:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787135779.211094:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000052c2415a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616347904:0@lo:501: 00000100:00100000:2.0:1787135779.211138:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008581d237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616348032:0@lo:503: 00000100:00100000:2.0:1787135779.211855:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135779.211907:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ec2f91f0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135779.216378:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616348032 00000100:00100000:1.0:1787135779.216393:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616348032 00000100:00100000:1.0:1787135779.216447:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787135779.216456:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d62d1c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+11:5802:x1873947616348032:12345-0@lo:503: 00000040:00080000:1.0:1787135779.216520:0:5813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787135779.216622:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d62d1c2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+11:5802:x1873947616348032:12345-0@lo:503: Request processed in 168us (4770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135779.216631:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787135779.219228:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008581d237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616348032:0@lo:503: 00000040:00080000:3.0:1787135779.223611:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787135779.226367:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787135779.226409:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787135779.226436:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202156 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.226449:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202156 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135779.226511:0:5802:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787135779.226514:0:5802:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e98456a5800 10000000:01000000:2.0:1787135779.226517:0:5802:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e98456a5800 10000000:01000000:2.0:1787135779.226522:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787135779.226528:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e98456a5800 from 1 10000000:01000000:2.0:1787135779.226530:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787135779.226592:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000062c477b5/0xf5850c552f20215d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.226601:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000062c477b5/0xf5850c552f20215d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.226611:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000062c477b5/0xf5850c552f20215d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135779.226631:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008581d237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616348160:0@lo:101: 00000100:00100000:2.0:1787135779.226712:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135779.226780:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 000000007007138e going to sleep for 11 seconds 00000100:00100000:1.0:1787135779.226969:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616348160 00000100:00100000:1.0:1787135779.226978:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616348160 00000100:00100000:1.0:1787135779.227034:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787135779.227042:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000af41e855 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+11:5802:x1873947616348160:12345-0@lo:101: 00010000:00010000:1.0:1787135779.227092:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135779.227104:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000099482028/0xf5850c552f202164 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20215d expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135779.227126:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000099482028/0xf5850c552f202164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20215d expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135779.227136:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000099482028/0xf5850c552f202164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20215d expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135779.227151:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000099482028, rc 0) 00000100:00100000:1.0:1787135779.227189:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000af41e855 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:5802:x1873947616348160:12345-0@lo:101: Request processed in 148us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135779.227196:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787135779.229334:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008581d237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616348160:0@lo:101: 00010000:00010000:2.0:1787135779.229359:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000062c477b5/0xf5850c552f20215d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202164 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.229371:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000062c477b5/0xf5850c552f20215d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202164 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135779.229446:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008581d237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616348288:0@lo:501: 00000100:00100000:2.0:1787135779.229498:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135779.229551:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 000000007007138e going to sleep for 11 seconds 00000100:00100000:3.0:1787135779.229573:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616348288 00000100:00100000:3.0:1787135779.229580:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616348288 00000100:00100000:3.0:1787135779.229625:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787135779.229633:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014d2a539 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:5802:x1873947616348288:12345-0@lo:501: 00000100:00100000:3.0:1787135779.229898:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014d2a539 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:5802:x1873947616348288:12345-0@lo:501: Request processed in 265us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135779.229906:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787135779.230363:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008581d237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616348288:0@lo:501: 00000100:00100000:2.0:1787135779.230395:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008581d237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616348416:0@lo:503: 00000100:00100000:2.0:1787135779.230433:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135779.230460:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 000000007007138e going to sleep for 11 seconds 00000100:00100000:0.0:1787135779.230523:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616348416 00000100:00100000:0.0:1787135779.230529:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616348416 00000100:00100000:0.0:1787135779.230573:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787135779.230578:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c59981ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:5802:x1873947616348416:12345-0@lo:503: 00000100:00100000:0.0:1787135779.230890:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c59981ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:5802:x1873947616348416:12345-0@lo:503: Request processed in 311us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135779.230897:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787135779.231135:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008581d237 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616348416:0@lo:503: 00000100:00100000:2.0:1787135779.231637:0:5850:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008581d237 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:5850:1873947616348544:0@lo:502: 00000100:00100000:2.0:1787135779.231688:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135779.231734:0:5850:0:(client.c:2702:ptlrpc_set_wait()) set 0000000060b886c6 going to sleep for 11 seconds 00000100:00100000:1.0:1787135779.232134:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616348544 00000100:00100000:1.0:1787135779.232142:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616348544 00000100:00100000:1.0:1787135779.232171:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787135779.232177:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008e6983f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:5850:x1873947616348544:12345-0@lo:502: 00000100:00100000:1.0:1787135779.232551:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008e6983f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:5850:x1873947616348544:12345-0@lo:502: Request processed in 373us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135779.232559:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787135779.232590:0:5850:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008581d237 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:5850:1873947616348544:0@lo:502: 00000020:01000004:2.0:1787135779.232650:0:5850:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787135779.232665:0:5850:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e44911bb) 00000020:00000080:2.0:1787135779.232683:0:5850:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787135779.232872:0:5850:0:(tgt_mount.c:153:server_get_mount()) get mount 000000008f167eca from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787135779.232876:0:5850:0:(tgt_mount.c:187:server_put_mount()) put mount 000000008f167eca from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787135779.232878:0:5850:0:(obd_mount.c:710:lustre_put_lsi()) put 000000008f167eca 4 00010000:00080000:2.0:1787135779.232904:0:5850:0:(ldlm_lib.c:103:import_set_conn()) imp 00000000ec4b0580@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1787135779.238476:0:5850:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787135779.238596:0:5850:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787135779.238632:0:5850:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787135779.238654:0:5850:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf5850c552f202172 00000100:00080000:2.0:1787135779.238665:0:5850:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787135779.238670:0:5850:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ec4b0580 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1787135779.238716:0:5850:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008581d237 x1873947616348672/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787135779.238742:0:5850:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787135779.239151:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008581d237 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873947616348672:0@lo:38: 00000100:00100000:0.0:1787135779.239219:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135779.239330:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616348672 00000100:00100000:3.0:1787135779.239338:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616348672 00000100:00100000:3.0:1787135779.239370:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787135779.239376:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087c17698 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1873947616348672:12345-0@lo:38: 00000100:00100000:3.0:1787135779.239426:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087c17698 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1873947616348672:12345-0@lo:38: Request processed in 50us (208us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787135779.239434:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787135779.239530:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787135779.239546:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000ec4b0580 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787135779.239551:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787135779.239554:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008581d237 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873947616348672:0@lo:38: 00000100:00100000:2.0:1787135779.239761:0:5850:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ba661596 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:5850:1873947616348800:0@lo:502: 00000100:00100000:2.0:1787135779.239807:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135779.240277:0:5850:0:(client.c:2702:ptlrpc_set_wait()) set 000000009d1fc1da going to sleep for 11 seconds 00000100:00100000:3.0:1787135779.242060:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616348800 00000100:00100000:3.0:1787135779.242074:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616348800 00000100:00100000:1.0:1787135779.242223:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787135779.242232:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000054e40913 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:5850:x1873947616348800:12345-0@lo:502: 00000100:00100000:1.0:1787135779.242500:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000054e40913 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:5850:x1873947616348800:12345-0@lo:502: Request processed in 269us (2693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135779.242509:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787135779.242680:0:5850:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ba661596 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:5850:1873947616348800:0@lo:502: 00000040:00080000:3.0:1787135779.242716:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787135779.242921:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787135779.242940:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787135779.242961:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 0000000062c477b5/0xf5850c552f20215d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202164 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135779.242971:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 0000000062c477b5/0xf5850c552f20215d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202164 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787135779.243015:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787135779.243018:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787135779.243024:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787135779.243025:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787135779.243026:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787135779.243027:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787135779.243028:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787135779.243029:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787135779.243030:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787135779.243031:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787135779.243032:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787135779.243034:0:5802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787135779.243037:0:5802:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787135779.243039:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787135779.243040:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787135779.243041:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787135779.243042:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787135779.243042:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787135779.243043:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787135779.243044:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787135779.243045:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787135779.243081:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787135779.243082:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787135779.243083:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787135779.243084:0:5802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787135779.243102:0:5802:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787135779.243115:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000080f3d93e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616348928:0@lo:253: 00000100:00100000:1.0:1787135779.243153:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135779.243180:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000598df316 going to sleep for 11 seconds 00000100:00100000:3.0:1787135779.243248:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616348928 00000100:00100000:3.0:1787135779.243259:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616348928 00000100:00100000:3.0:1787135779.243295:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787135779.243301:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000041866f17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:5802:x1873947616348928:12345-0@lo:253: 20000000:01000000:3.0:1787135779.243323:0:5815:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787135779.243337:0:5815:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787135779.322412:0:5815:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787135779.322431:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1787135779.323751:0:5837:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787135779.323759:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787135779.323781:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135779.323802:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ff76dc79/0xf5850c552f202148 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202141 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135779.323810:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135779.323844:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ff76dc79/0xf5850c552f202148 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f202141 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135779.323857:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ff76dc79/0xf5850c552f202148 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f202141 expref: 12 pid: 5813 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135779.323870:0:5837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000097183bca pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1873947616349056:0@lo:104: 00000100:00100000:0.0:1787135779.323929:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135779.324005:0:5837:0:(client.c:2702:ptlrpc_set_wait()) set 0000000009a180b5 going to sleep for 11 seconds 00000100:00100000:2.0:1787135779.324347:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616349056 00000100:00100000:2.0:1787135779.324354:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616349056 00000100:00100000:2.0:1787135779.324406:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787135779.324414:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fafa13d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+3:5837:x1873947616349056:12345-0@lo:104: 00010000:00010000:2.0:1787135779.324433:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202148 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324492:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135779.324497:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fafa13d6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+3:5837:x1873947616349056:12345-0@lo:104: Request processed in 85us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135779.324504:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787135779.324524:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135779.324529:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202148 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324535:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006d410559 already unused, calling callback (00000000ee42835b) 10000000:00010000:2.0:1787135779.324547:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202148 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324555:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202148 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135779.324561:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202148 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135779.324566:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135779.324593:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202148 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324600:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135779.324615:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202148 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324621:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 000000006d410559/0xf5850c552f202141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202148 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324646:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135779.324648:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135779.324649:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135779.324704:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000585e9f91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616349184:0@lo:103: 00000100:00100000:2.0:1787135779.324734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135779.324801:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616349184 00000100:00100000:2.0:1787135779.324805:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616349184 00010000:00010000:2.0:1787135779.324819:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ff76dc79/0xf5850c552f202148 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202141 expref: 13 pid: 5813 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135779.324839:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787135779.324844:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000739dd201 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e67bffa2-3749-4eab-9303-62ad12948de4+13:3301:x1873947616349184:12345-0@lo:103: 00010000:00010000:2.0:1787135779.324852:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135779.324855:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ff76dc79/0xf5850c552f202148 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202141 expref: 13 pid: 5813 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324864:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ff76dc79/0xf5850c552f202148 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f202141 expref: 13 pid: 5813 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324877:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324883:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787135779.324896:0:5806:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001137065s 00010000:00010000:2.0:1787135779.324900:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324915:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324920:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324924:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324928:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bfc63c8d already unused, calling callback (00000000ca6499d4) 00010000:00010000:2.0:1787135779.324932:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324937:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324946:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135779.324954:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135779.324982:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000739dd201 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e67bffa2-3749-4eab-9303-62ad12948de4+13:3301:x1873947616349184:12345-0@lo:103: Request processed in 138us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135779.324989:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787135779.325034:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000585e9f91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616349184:0@lo:103: 00010000:00010000:3.0:1787135779.325413:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ff76dc79/0xf5850c552f202148 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f202141 expref: 12 pid: 5813 timeout: 289 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135779.325425:0:5837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000097183bca pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1873947616349056:0@lo:104: 00010000:00010000:3.0:1787135779.325437:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135779.325445:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135779.325451:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135779.325456:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bfc63c8d/0xf5850c552f202179 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135779.330108:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000041866f17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+11:5802:x1873947616348928:12345-0@lo:253: Request processed in 86799us (86948us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135779.330124:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787135779.330350:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000080f3d93e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:5802:1873947616348928:0@lo:253: 10000000:01000000:3.0:1787135779.330365:0:5802:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787135779.330368:0:5802:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787135779.330370:0:5802:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787135779.330371:0:5802:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787135779.330372:0:5802:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787135779.330373:0:5802:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787135779.330374:0:5802:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787135779.330375:0:5802:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787135779.330377:0:5802:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787135779.330378:0:5802:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787135779.330393:0:5802:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787135779.330394:0:5802:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787135779.330396:0:5802:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787135779.330407:0:5802:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787135779.343535:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787135779.343960:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787135779.346916:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787135779.347617:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787135779.347841:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787135779.348770:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787135779.361682:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787135779.361870:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787135779.362130:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787135779.362305:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787135779.362521:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787135779.362705:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787135779.470426:0:5802:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1787135779.563762:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1787135779.564070:0:5855:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787135779.564075:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787135779.564227:0:5856:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787135779.568850:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787135779.569044:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787135779.575022:0:5802:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787135779.575044:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787135779.585995:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787135779.587012:0:5802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787135779.593007:0:5802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787135779.595780:0:5802:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787135779.608531:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1787135779.611076:0:5802:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1787135779.612405:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1787135779.612571:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1787135779.612710:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1787135779.613114:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1787135779.613255:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1787135779.613462:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1787135779.613759:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1787135779.613906:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1787135779.614084:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1787135779.614224:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1787135779.614372:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1787135779.614523:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1787135779.627930:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1787135779.628189:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1787135779.628352:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1787135779.628493:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1787135779.628903:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1787135779.631082:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1787135779.631267:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1787135779.631433:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1787135779.631598:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1787135779.633258:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1787135779.635294:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1787135779.635492:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1787135779.635658:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1787135779.635821:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1787135779.635952:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1787135779.636287:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1787135779.636510:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1787135779.636671:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1787135779.637228:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1787135779.637591:0:5802:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1787135779.638260:0:5802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787135779.683604:0:5856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787135779.776182:0:5802:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787135779.776218:0:5802:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f5d81c3b988 00100000:10000000:2.0:1787135779.776225:0:5802:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:1.0:1787135779.776869:0:5856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787135779.776927:0:5856:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787135779.776937:0:5856:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:1.0:1787135779.777763:0:5802:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787135779.777778:0:5802:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787135779.777790:0:5802:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787135779.777813:0:5802:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1787135779.942907:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135780.953018:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135781.977184:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135783.000211:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135784.027418:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787135784.409709:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787135784.409720:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787135784.409722:0:8:0:(import.c:65:import_set_state_nolock()) 00000000ec4b0580 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787135784.409734:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000ec4b0580 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1787135784.409754:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000087bcdd91 x1873947616349440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787135784.409794:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000087bcdd91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873947616349440:0@lo:38: 00000100:00100000:3.0:1787135784.410091:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787135784.410102:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000005df254 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616349312:0@lo:400: 00000100:00100000:3.0:1787135784.410161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135784.410215:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616349312 00000100:00100000:3.0:1787135784.410222:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616349312 00000100:00100000:3.0:1787135784.410260:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787135784.410279:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f20fd69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+11:3303:x1873947616349312:12345-0@lo:400: 00000100:00100000:3.0:1787135784.410336:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f20fd69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+11:3303:x1873947616349312:12345-0@lo:400: Request processed in 69us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135784.410358:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787135784.410398:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000005df254 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616349312:0@lo:400: 00000100:00100000:1.0:1787135784.410730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135784.410927:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616349440 00000100:00100000:0.0:1787135784.410933:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616349440 00000100:00100000:0.0:1787135784.410960:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787135784.410965:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7e84609 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1873947616349440:12345-0@lo:38: 00010000:00080000:0.0:1787135784.410986:0:5823:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:0.0:1787135784.411016:0:5823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf5850c552f202180 00000004:00100000:0.0:1787135784.411088:0:5823:0:(mdt_handler.c:7490:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787135784.411198:0:5823:0:(import.c:65:import_set_state_nolock()) 00000000a135a3b7 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787135784.411241:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7e84609 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873947616349440:12345-0@lo:38: Request processed in 274us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135784.411260:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787135784.411491:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000087bcdd91 x1873947616349440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787135794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787135784.411514:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787135784.411520:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787135784.411525:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787135784.411527:0:3299:0:(import.c:65:import_set_state_nolock()) 00000000ec4b0580 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787135784.411532:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000087bcdd91 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873947616349440:0@lo:38: 00000001:02000400:2.0:1787135784.729113:0:6099:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787135785.056699:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135786.072283:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787135786.968349:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787135786.968357:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e98456a5800 from 3 10000000:01000000:2.0:1787135786.968361:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787135786.968404:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 00000000d3d85d6f/0xf5850c552f202187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135786.968414:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 00000000d3d85d6f/0xf5850c552f202187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135786.968434:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 00000000d3d85d6f/0xf5850c552f202187 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135786.968457:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000585e9f91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616349568:0@lo:101: 00000100:00100000:2.0:1787135786.968570:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135786.968639:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 000000005ded79d5 going to sleep for 11 seconds 00000100:00100000:0.0:1787135786.969089:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616349568 00000100:00100000:0.0:1787135786.969098:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616349568 00000100:00100000:0.0:1787135786.969150:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787135786.969158:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bfba8026 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+11:5818:x1873947616349568:12345-0@lo:101: 00010000:00010000:0.0:1787135786.969171:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135786.969362:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bfc63c8d/0xf5850c552f20218e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202187 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135786.969385:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bfc63c8d/0xf5850c552f20218e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202187 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135786.969394:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bfc63c8d/0xf5850c552f20218e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202187 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135786.969403:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bfc63c8d, rc 0) 00000100:00100000:0.0:1787135786.969462:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bfba8026 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:5818:x1873947616349568:12345-0@lo:101: Request processed in 304us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135786.969469:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787135786.969620:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000585e9f91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616349568:0@lo:101: 00010000:00010000:2.0:1787135786.969634:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 00000000d3d85d6f/0xf5850c552f202187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20218e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135786.969643:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 00000000d3d85d6f/0xf5850c552f202187 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20218e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135786.969693:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000585e9f91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616349696:0@lo:256: 00000100:00100000:2.0:1787135786.969727:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135786.969758:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 000000005ded79d5 going to sleep for 11 seconds 00000100:00100000:1.0:1787135786.969809:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616349696 00000100:00100000:1.0:1787135786.969814:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616349696 00000100:00100000:1.0:1787135786.969845:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787135786.969852:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cdc43f9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:5818:x1873947616349696:12345-0@lo:256: 20000000:01000000:1.0:1787135786.969865:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787135786.969880:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787135786.969887:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787135786.969970:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cdc43f9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:5818:x1873947616349696:12345-0@lo:256: Request processed in 119us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135786.969976:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787135786.971633:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000585e9f91 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616349696:0@lo:256: 10000000:01000000:2.0:1787135786.971696:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787135786.971705:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: 00000000d3d85d6f/0xf5850c552f202187 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20218e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135786.971714:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: 00000000d3d85d6f/0xf5850c552f202187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20218e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135787.096858:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135788.135870:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135789.145801:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135789.530901:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787135789.530926:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005b0e7dd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616349824:0@lo:400: 00000100:00100000:2.0:1787135789.530997:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135789.531094:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000026032344 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616349952:0@lo:400: 00000100:00100000:2.0:1787135789.531180:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135789.531224:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616349952 00000100:00100000:2.0:1787135789.531231:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616349952 00000100:00100000:2.0:1787135789.531270:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787135789.531277:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000585e9f91 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616349952:12345-0@lo:400: 00000100:00100000:2.0:1787135789.531337:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000585e9f91 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616349952:12345-0@lo:400: Request processed in 60us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135789.531344:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787135789.531385:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000026032344 x1873947616349952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135789.531559:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000026032344 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616349952:0@lo:400: 00000100:00100000:3.0:1787135789.531997:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616349824 00000100:00100000:3.0:1787135789.532003:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616349824 00000100:00100000:3.0:1787135789.532044:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787135789.532078:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000000280675 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:3302:x1873947616349824:12345-0@lo:400: 00000100:00100000:3.0:1787135789.532119:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000000280675 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:3302:x1873947616349824:12345-0@lo:400: Request processed in 43us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135789.532147:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787135789.536156:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005b0e7dd6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616349824:0@lo:400: 00010000:00010000:3.0:1787135790.168218:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787135790.373116:0:6302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc69e5e1e0 20000000:00000080:0.0:1787135790.373133:0:6302:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e987c70a400 uarg=0000000000000000 20000000:01000000:0.0:1787135790.373340:0:6302:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787135790.373348:0:6302:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787135790.373353:0:6302:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787135790.373562:0:6302:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787135790.373571:0:6302:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1787135790.378414:0:6302:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787135790.378691:0:6302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787135790.378746:0:6302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1787135790.378810:0:6302:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1787135790.378828:0:6302:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787135790.378844:0:6302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135790.378861:0:6302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000077460dc4/0xf5850c552f202156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20214f expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135790.378868:0:6302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135790.378903:0:6302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000077460dc4/0xf5850c552f202156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f20214f expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135790.378918:0:6302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000077460dc4/0xf5850c552f202156 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f20214f expref: 11 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135790.378931:0:6302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b96f767e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6302:1873947616350080:0@lo:104: 00000100:00100000:0.0:1787135790.378989:0:6302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135790.379112:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616350080 00000100:00100000:2.0:1787135790.379120:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616350080 00000100:00100000:2.0:1787135790.379389:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787135790.379398:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000042428a62 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:6302:x1873947616350080:12345-0@lo:104: 00010000:00010000:2.0:1787135790.379410:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202156 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135790.379471:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135790.379476:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000042428a62 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:6302:x1873947616350080:12345-0@lo:104: Request processed in 81us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135790.379483:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787135790.379528:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787135790.379533:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202156 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379540:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000339cf75f already unused, calling callback (00000000ee42835b) 10000000:00010000:3.0:1787135790.379543:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202156 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379551:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202156 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787135790.379557:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202156 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787135790.379562:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787135790.379592:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202156 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379598:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787135790.379614:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202156 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379619:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: 00000000339cf75f/0xf5850c552f20214f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202156 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379635:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135790.379636:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135790.379637:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135790.379653:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005cdb6f67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616350208:0@lo:103: 00000100:00100000:3.0:1787135790.379680:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135790.379718:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616350208 00000100:00100000:3.0:1787135790.379722:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616350208 00010000:00010000:3.0:1787135790.379737:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000077460dc4/0xf5850c552f202156 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20214f expref: 12 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135790.379756:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787135790.379761:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007a4896cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e67bffa2-3749-4eab-9303-62ad12948de4+12:3301:x1873947616350208:12345-0@lo:103: 00010000:00010000:3.0:1787135790.379770:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135790.379773:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000077460dc4/0xf5850c552f202156 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20214f expref: 12 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379782:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000077460dc4/0xf5850c552f202156 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f20214f expref: 12 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379796:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379803:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379813:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379819:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379824:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379838:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379843:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000772b3031 already unused, calling callback (00000000ca6499d4) 00010000:00010000:3.0:1787135790.379846:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379852:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379860:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135790.379869:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135790.379895:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007a4896cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e67bffa2-3749-4eab-9303-62ad12948de4+12:3301:x1873947616350208:12345-0@lo:103: Request processed in 134us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135790.379902:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787135790.379934:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005cdb6f67 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616350208:0@lo:103: 00000100:00100000:0.0:1787135790.382577:0:6302:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a856acb6 going to sleep for 11 seconds 00010000:00010000:0.0:1787135790.382617:0:6302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000077460dc4/0xf5850c552f202156 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f20214f expref: 11 pid: 5813 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135790.382632:0:6302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b96f767e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6302:1873947616350080:0@lo:104: 00010000:00010000:0.0:1787135790.382653:0:6302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135790.382662:0:6302:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135790.382668:0:6302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135790.382684:0:6302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000772b3031/0xf5850c552f202195 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135791.194489:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135792.217174:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787135792.856224:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787135792.856232:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e98456a5800 from 1 10000000:01000000:2.0:1787135792.856237:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787135792.856277:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: 0000000055201035/0xf5850c552f20219c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135792.856289:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: 0000000055201035/0xf5850c552f20219c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135792.856300:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: 0000000055201035/0xf5850c552f20219c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135792.856330:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b6c70651 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616350336:0@lo:101: 00000100:00100000:2.0:1787135792.856394:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135792.856463:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 000000002fe8b58c going to sleep for 11 seconds 00000100:00100000:0.0:1787135792.856523:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616350336 00000100:00100000:0.0:1787135792.856531:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616350336 00000100:00100000:0.0:1787135792.856586:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787135792.856594:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000090142174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+11:5818:x1873947616350336:12345-0@lo:101: 00010000:00010000:0.0:1787135792.856607:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135792.856619:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000057437b2d/0xf5850c552f2021a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20219c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135792.856639:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000057437b2d/0xf5850c552f2021a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20219c expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135792.856649:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000057437b2d/0xf5850c552f2021a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20219c expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135792.856658:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000057437b2d, rc 0) 00000100:00100000:0.0:1787135792.856711:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000090142174 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:5818:x1873947616350336:12345-0@lo:101: Request processed in 118us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135792.856718:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787135792.856762:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b6c70651 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616350336:0@lo:101: 00010000:00010000:0.0:1787135792.856775:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: 0000000055201035/0xf5850c552f20219c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2021a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135792.856783:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: 0000000055201035/0xf5850c552f20219c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2021a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135792.856841:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b96f767e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616350464:0@lo:501: 00000100:00100000:0.0:1787135792.856866:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135792.856893:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a6017ca4 going to sleep for 11 seconds 00000100:00100000:0.0:1787135792.856907:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616350464 00000100:00100000:0.0:1787135792.856911:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616350464 00000100:00100000:0.0:1787135792.856932:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787135792.856938:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c01d12a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:5818:x1873947616350464:12345-0@lo:501: 00000100:00100000:0.0:1787135792.857184:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c01d12a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:5818:x1873947616350464:12345-0@lo:501: Request processed in 246us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135792.857192:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787135792.857221:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b96f767e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616350464:0@lo:501: 00000100:00100000:0.0:1787135792.857246:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b96f767e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616350592:0@lo:503: 00000100:00100000:0.0:1787135792.857283:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135792.857302:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a6017ca4 going to sleep for 11 seconds 00000100:00100000:0.0:1787135792.857312:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616350592 00000100:00100000:0.0:1787135792.857316:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616350592 00000100:00100000:0.0:1787135792.857335:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787135792.857340:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d9181431 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:5818:x1873947616350592:12345-0@lo:503: 00000100:00100000:0.0:1787135792.857463:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d9181431 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:5818:x1873947616350592:12345-0@lo:503: Request processed in 122us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135792.857470:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787135792.857543:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b96f767e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616350592:0@lo:503: 00000100:00100000:0.0:1787135792.857834:0:6412:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b96f767e pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:6412:1873947616350720:0@lo:502: 00000100:00100000:0.0:1787135792.857881:0:6412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135792.857937:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616350720 00000100:00100000:0.0:1787135792.857942:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616350720 00000100:00100000:0.0:1787135792.857975:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787135792.857980:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000faf561f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:6412:x1873947616350720:12345-0@lo:502: 00000100:00100000:0.0:1787135792.858105:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000faf561f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:6412:x1873947616350720:12345-0@lo:502: Request processed in 113us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135792.858112:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787135792.858162:0:6412:0:(client.c:2702:ptlrpc_set_wait()) set 000000003b08ba29 going to sleep for 11 seconds 00000100:00100000:0.0:1787135792.858174:0:6412:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b96f767e pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:6412:1873947616350720:0@lo:502: 00000020:01000000:0.0:1787135792.858205:0:6412:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787135792.858214:0:6412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135792.858216:0:6412:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787135792.858240:0:6412:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e98456a5800 00000020:00000080:0.0:1787135792.858242:0:6412:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787135792.858312:0:6412:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:6412:1873947616350848:0@lo:502: 00000100:00100000:0.0:1787135792.858383:0:6412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135792.858412:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616350848 00000100:00100000:0.0:1787135792.858416:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616350848 00000100:00100000:0.0:1787135792.858472:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787135792.858480:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:6412:x1873947616350848:12345-0@lo:502: 00000100:00100000:0.0:1787135792.858623:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:6412:x1873947616350848:12345-0@lo:502: Request processed in 143us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135792.858629:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787135792.858687:0:6412:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9845668600 going to sleep for 11 seconds 00000100:00100000:0.0:1787135792.858711:0:6412:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:6412:1873947616350848:0@lo:502: 00000020:01000000:0.0:1787135792.858742:0:6412:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787135792.858759:0:6412:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135792.858761:0:6412:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787135792.858769:0:6412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787135792.858846:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787135792.858861:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787135792.858879:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cb200/0xf5850c552f20219c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2021a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135792.858889:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98413cb200/0xf5850c552f20219c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2021a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135793.240368:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135794.264200:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135794.648391:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616350976:0@lo:400: 00000100:00100000:0.0:1787135794.648472:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135794.648531:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787135794.648538:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616351104:0@lo:400: 00000100:00100000:0.0:1787135794.648567:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135794.648599:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616351104 00000100:00100000:0.0:1787135794.648606:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616351104 00000100:00100000:0.0:1787135794.648651:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787135794.648660:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616351104:12345-0@lo:400: 00000100:00100000:0.0:1787135794.648711:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616351104:12345-0@lo:400: Request processed in 52us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135794.648718:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787135794.648758:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e987bd54a80 x1873947616351104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135794.648771:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616351104:0@lo:400: 00000100:00100000:3.0:1787135794.649337:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616350976 00000100:00100000:3.0:1787135794.649343:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616350976 00000100:00100000:3.0:1787135794.649375:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787135794.649382:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:3302:x1873947616350976:12345-0@lo:400: 00000100:00100000:3.0:1787135794.649426:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:3302:x1873947616350976:12345-0@lo:400: Request processed in 44us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135794.649444:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787135794.650105:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616350976:0@lo:400: 00010000:00010000:0.0:1787135795.293542:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135796.312148:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787135797.234667:0:6670:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787135797.234671:0:6670:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787135797.234811:0:6670:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e98735aa000 00000020:01000004:3.0:1787135797.234827:0:6670:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787135797.234841:0:6670:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787135797.234854:0:6670:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e9860763380) 00000020:00000080:3.0:1787135797.234869:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787135797.258276:0:6670:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787135797.259635:0:6670:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787135797.287885:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787135797.294147:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787135797.294182:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787135797.294237:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787135797.294266:0:6670:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787135797.294747:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787135797.294823:0:6670:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787135797.294834:0:6670:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf5850c552f2021b1 00000020:01000004:3.0:1787135797.294842:0:6670:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787135797.294861:0:6670:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787135797.294865:0:6670:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787135797.294871:0:6670:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787135797.294876:0:6670:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787135797.294888:0:6670:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e98607619c0) 00000020:00000080:3.0:1787135797.294898:0:6670:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1787135797.296117:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787135797.296272:0:6670:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787135797.296279:0:6670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787135797.298038:0:6670:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787135797.298185:0:6670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787135797.302477:0:6670:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787135797.302490:0:6670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787135797.304654:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787135797.304824:0:6670:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787135797.304830:0:6670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787135797.313198:0:6670:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787135797.313217:0:6670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:0.0:1787135797.337219:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135797.342356:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787135797.342603:0:6670:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787135797.342610:0:6670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787135797.344907:0:6670:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787135797.344919:0:6670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787135797.346321:0:6670:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787135797.346331:0:6670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787135797.349896:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787135797.350324:0:6670:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787135797.350332:0:6670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787135797.351277:0:6670:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787135797.351286:0:6670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787135797.410936:0:6670:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787135797.411183:0:6670:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787135797.411189:0:6670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787135797.412389:0:6670:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787135797.412399:0:6670:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787135797.412905:0:6670:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787135797.412929:0:6670:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787135797.412935:0:6670:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787135797.479398:0:6670:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787135797.479447:0:6670:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787135797.479451:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787135797.479453:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787135797.479454:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787135797.479456:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787135797.479457:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787135797.479458:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787135797.479460:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787135797.479461:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787135797.479462:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787135797.479464:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787135797.479465:0:6670:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787135797.479469:0:6670:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787135797.479471:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787135797.479473:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787135797.479473:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787135797.479474:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787135797.479475:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787135797.479476:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787135797.479478:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787135797.479479:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787135797.479480:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787135797.479481:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787135797.479482:0:6670:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787135797.479506:0:6670:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787135797.479525:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616351232:0@lo:253: 00000100:00100000:0.0:1787135797.479590:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.479762:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9851340cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135797.484992:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616351232 00000100:00100000:2.0:1787135797.485009:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616351232 00000100:00100000:2.0:1787135797.485091:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787135797.485103:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:6670:x1873947616351232:12345-0@lo:253: 20000000:01000000:2.0:1787135797.485136:0:5815:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787135797.485141:0:5815:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787135797.485146:0:5815:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787135797.485149:0:5815:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787135797.486405:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787135797.486710:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787135797.486739:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787135797.486790:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787135797.486798:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787135797.486828:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787135797.486880:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787135797.489313:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787135797.489344:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:2.0:1787135797.489347:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:2.0:1787135797.489387:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787135797.489395:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787135797.489461:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787135797.489469:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:2.0:1787135797.489505:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787135797.489515:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787135797.489545:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787135797.489731:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1787135797.491312:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1787135797.491338:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:3.0:1787135797.491341:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:3.0:1787135797.491376:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1787135797.491384:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787135797.491427:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1787135797.491435:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:3.0:1787135797.491482:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1787135797.491491:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1787135797.491523:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1787135797.491556:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1787135797.491571:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787135797.491573:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787135797.491577:0:5815:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787135797.491588:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787135797.491591:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787135797.491739:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787135797.491742:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1787135797.493271:0:6685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1787135797.493350:0:6685:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1787135797.493406:0:6685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1787135797.494172:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1787135797.494234:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1787135797.494946:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1787135797.494974:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787135797.494977:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787135797.498300:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1787135797.498392:0:6686:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1787135797.498452:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787135797.499223:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787135797.499274:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787135797.499306:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787135797.499320:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787135797.499322:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787135797.499905:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787135797.500269:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787135797.500311:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787135797.500371:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787135797.500387:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787135797.500389:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787135797.500399:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787135797.500427:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.500445:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841489e00/0xf5850c552f2020d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2020d1 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.500453:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98820e3400/0xf5850c552f2020f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2020ed expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.500461:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841488400/0xf5850c552f202164 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20215d expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.500468:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.500508:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841488400/0xf5850c552f202164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f20215d expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.500537:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9841488400/0xf5850c552f202164 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f20215d expref: 12 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135797.500551:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874979f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616351360:0@lo:104: 00000100:00100000:1.0:1787135797.500797:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787135797.500909:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98820e3400/0xf5850c552f2020f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f2020ed expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.500920:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e98820e3400/0xf5850c552f2020f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f2020ed expref: 12 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135797.500929:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874978a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616351488:0@lo:104: 00000100:00100000:1.0:1787135797.500953:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787135797.500984:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841489e00/0xf5850c552f2020d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f2020d1 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.500992:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9841489e00/0xf5850c552f2020d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f2020d1 expref: 12 pid: 5813 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135797.500999:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874978380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616351616:0@lo:104: 00000100:00100000:1.0:1787135797.501020:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135797.501030:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98741076c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135797.501166:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616351360 00000100:00100000:2.0:1787135797.501173:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616351360 00000100:00100000:2.0:1787135797.501206:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616351488 00000100:00100000:2.0:1787135797.501209:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616351488 00000100:00100000:2.0:1787135797.501218:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616351616 00000100:00100000:2.0:1787135797.501220:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616351616 00000100:00100000:2.0:1787135797.501232:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787135797.501240:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+5:5815:x1873947616351360:12345-0@lo:104: 00010000:00010000:2.0:1787135797.501252:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f20215d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202164 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501316:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135797.501329:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+5:5815:x1873947616351360:12345-0@lo:104: Request processed in 90us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135797.501336:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787135797.501353:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787135797.501359:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874979880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+4:5815:x1873947616351488:12345-0@lo:104: 00010000:00010000:2.0:1787135797.501367:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2020ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2020f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501403:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787135797.501409:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874979880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+4:5815:x1873947616351488:12345-0@lo:104: Request processed in 50us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135797.501426:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787135797.501438:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787135797.501444:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:5815:x1873947616351616:12345-0@lo:104: 00010000:00010000:2.0:1787135797.501452:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f2020d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2020d8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501479:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787135797.501484:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:5815:x1873947616351616:12345-0@lo:104: Request processed in 41us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135797.501489:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787135797.501504:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787135797.501510:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f20215d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202164 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501518:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cae00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135797.501521:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f20215d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202164 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501540:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f20215d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202164 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135797.501546:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f20215d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202164 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135797.501552:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135797.501589:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f20215d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202164 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501604:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135797.501629:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f20215d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202164 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501636:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f20215d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202164 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501652:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787135797.501655:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2020ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2020f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501661:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840031000 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135797.501664:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2020ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f2020f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501671:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2020ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f2020f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135797.501678:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2020ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f2020f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135797.501690:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135797.501704:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2020ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2020f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501710:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135797.501716:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2020ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2020f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501723:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2020ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2020f4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501734:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135797.501737:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f2020d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2020d8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501744:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2400 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135797.501747:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f2020d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f2020d8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501754:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f2020d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f2020d8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135797.501761:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f2020d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f2020d8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135797.501767:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135797.501778:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f2020d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2020d8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501784:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135797.501804:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f2020d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2020d8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501811:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f2020d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2020d8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.501828:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135797.501831:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135797.501833:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135797.501961:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874979f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616351360:0@lo:104: 00000100:00100000:1.0:1787135797.501971:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874978a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616351488:0@lo:104: 00000100:00100000:1.0:1787135797.501977:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874978380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616351616:0@lo:104: 00010000:00010000:1.0:1787135797.501999:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135797.502268:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135797.502289:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616351744:0@lo:103: 00000100:00100000:3.0:1787135797.502327:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135797.502356:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787135797.502362:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616351872:0@lo:103: 00000100:00100000:3.0:1787135797.502382:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135797.502532:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616352000:0@lo:103: 00000100:00100000:2.0:1787135797.502559:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135797.502907:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616351744 00000100:00100000:1.0:1787135797.502914:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616351744 00010000:00010000:1.0:1787135797.502940:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841488400/0xf5850c552f202164 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20215d expref: 13 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135797.502957:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616351872 00000100:00100000:1.0:1787135797.502960:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616351872 00010000:00010000:1.0:1787135797.502969:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98820e3400/0xf5850c552f2020f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2020ed expref: 14 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135797.502979:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616352000 00000100:00100000:1.0:1787135797.502981:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616352000 00010000:00010000:1.0:1787135797.502990:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841489e00/0xf5850c552f2020d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2020d1 expref: 15 pid: 5813 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135797.503001:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787135797.503007:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+15:3300:x1873947616351744:12345-0@lo:103: 00010000:00010000:1.0:1787135797.503018:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135797.503023:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841488400/0xf5850c552f202164 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20215d expref: 15 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503034:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841488400/0xf5850c552f202164 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f20215d expref: 15 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503080:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841488400/0xf5850c552f202164 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f20215d expref: 15 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503095:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135797.503133:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+14:3300:x1873947616351744:12345-0@lo:103: Request processed in 126us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135797.503150:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787135797.503166:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787135797.503173:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+13:3300:x1873947616351872:12345-0@lo:103: 00010000:00010000:1.0:1787135797.503179:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135797.503183:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98820e3400/0xf5850c552f2020f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2020ed expref: 13 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503191:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98820e3400/0xf5850c552f2020f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f2020ed expref: 13 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503200:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98820e3400/0xf5850c552f2020f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f2020ed expref: 13 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503210:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135797.503232:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+12:3300:x1873947616351872:12345-0@lo:103: Request processed in 60us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135797.503238:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787135797.503250:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787135797.503257:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+11:3302:x1873947616352000:12345-0@lo:103: 00010000:00010000:1.0:1787135797.503264:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135797.503268:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841489e00/0xf5850c552f2020d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2020d1 expref: 11 pid: 5813 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503277:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841489e00/0xf5850c552f2020d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f2020d1 expref: 11 pid: 5813 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503287:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841489e00/0xf5850c552f2020d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f2020d1 expref: 11 pid: 5813 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503309:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503317:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503331:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503339:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503347:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503354:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503359:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841489000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787135797.503363:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503371:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503386:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503395:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135797.503433:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+10:3302:x1873947616352000:12345-0@lo:103: Request processed in 176us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135797.503448:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1787135797.503468:0:5815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503476:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.503481:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841489000/0xf5850c552f2021bf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787135797.503493:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787135797.503582:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616351872:0@lo:103: 00000100:00100000:2.0:1787135797.503600:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616351744:0@lo:103: 00000100:00100000:2.0:1787135797.503662:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616352000:0@lo:103: 00000100:00100000:2.0:1787135797.548169:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+9:6670:x1873947616351232:12345-0@lo:253: Request processed in 63062us (68572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135797.548184:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787135797.548613:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616351232:0@lo:253: 10000000:01000000:0.0:1787135797.548645:0:6670:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787135797.548649:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787135797.548650:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787135797.548651:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787135797.548653:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787135797.548654:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787135797.548655:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787135797.548657:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787135797.548658:0:6670:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787135797.548660:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787135797.548661:0:6670:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787135797.548680:0:6670:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e98735aa000 from lustre-OST0000 10000000:01000000:0.0:1787135797.548707:0:6670:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787135797.548710:0:6670:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787135797.548716:0:6670:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e9860760000 local copy 10000000:01000000:0.0:1787135797.548721:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787135797.548757:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.548768:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.548777:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135797.548795:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616352128:0@lo:101: 00000100:00100000:0.0:1787135797.548833:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.548891:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135797.549081:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616352128 00000100:00100000:2.0:1787135797.549088:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616352128 00000100:00100000:2.0:1787135797.549135:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787135797.549143:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+9:6670:x1873947616352128:12345-0@lo:101: 00010000:00010000:2.0:1787135797.549156:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135797.549171:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98413cae00/0xf5850c552f2021cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2021c6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.549192:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98413cae00/0xf5850c552f2021cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2021c6 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.549214:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98413cae00/0xf5850c552f2021cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2021c6 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.549222:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98413cae00, rc 0) 00000100:00100000:2.0:1787135797.549257:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+10:6670:x1873947616352128:12345-0@lo:101: Request processed in 114us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135797.549266:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787135797.549459:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616352128:0@lo:101: 00010000:00010000:0.0:1787135797.549472:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf5850c552f2021cd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.549492:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf5850c552f2021cd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135797.549620:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616352256:0@lo:501: 00000100:00100000:0.0:1787135797.549647:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.549858:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135797.549956:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616352256 00000100:00100000:3.0:1787135797.549962:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616352256 00000100:00100000:3.0:1787135797.550031:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787135797.550039:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+10:6670:x1873947616352256:12345-0@lo:501: 00000100:00100000:3.0:1787135797.550379:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+10:6670:x1873947616352256:12345-0@lo:501: Request processed in 340us (730us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787135797.550387:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787135797.550457:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616352256:0@lo:501: 10000000:01000000:0.0:1787135797.550474:0:6670:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787135797.550501:0:6670:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787135797.550508:0:6670:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf5850c552f2021cd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.550518:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf5850c552f2021cd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.550525:0:6670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf5850c552f2021cd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.550548:0:6670:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787135797.550578:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e98735aa000 10000000:01000000:0.0:1787135797.550584:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787135797.550589:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e9860760000 10000000:01000000:0.0:1787135797.550592:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787135797.550595:0:6670:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8e9860760000 from 1 10000000:01000000:0.0:1787135797.550598:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787135797.550620:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2021d4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.550638:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2021d4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.550647:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2021d4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135797.550661:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616352384:0@lo:101: 00000100:00100000:0.0:1787135797.550689:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787135797.550728:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787135797.550735:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf5850c552f2021cd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.550742:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840030a00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:1.0:1787135797.550746:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf5850c552f2021cd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.550754:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf5850c552f2021cd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787135797.550760:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf5850c552f2021cd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787135797.550765:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787135797.550783:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf5850c552f2021cd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.550788:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787135797.550813:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf5850c552f2021cd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.550821:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f2021c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf5850c552f2021cd expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.550838:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135797.550841:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135797.550843:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135797.550998:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787135797.551064:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616352384 00000100:00100000:2.0:1787135797.551069:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616352384 00000100:00100000:2.0:1787135797.551094:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787135797.551101:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+10:6670:x1873947616352384:12345-0@lo:101: 00010000:00010000:2.0:1787135797.551122:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135797.551137:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98413ca200/0xf5850c552f2021db lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2021d4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.551156:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98413ca200/0xf5850c552f2021db lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2021d4 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.551166:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98413ca200/0xf5850c552f2021db lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2021d4 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.551174:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98413ca200, rc 0) 00000100:00100000:2.0:1787135797.551262:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+11:6670:x1873947616352384:12345-0@lo:101: Request processed in 161us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135797.551269:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787135797.551299:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616352512:0@lo:103: 00000100:00100000:2.0:1787135797.551325:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135797.551368:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616352512 00000100:00100000:2.0:1787135797.551373:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616352512 00000100:00100000:2.0:1787135797.551400:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787135797.551406:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+11:3303:x1873947616352512:12345-0@lo:103: 00010000:00010000:2.0:1787135797.551424:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135797.551437:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98413cae00/0xf5850c552f2021cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f2021c6 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.551451:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135797.551476:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+10:3303:x1873947616352512:12345-0@lo:103: Request processed in 71us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135797.551482:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787135797.551510:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874978380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616352512:0@lo:103: 00000100:00100000:0.0:1787135797.551715:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616352384:0@lo:101: 00010000:00010000:0.0:1787135797.551727:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2021d4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2021db expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.551736:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2021d4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2021db expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135797.551751:0:6670:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787135797.551767:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2021d4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2021db expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.551775:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2021d4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2021db expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135797.551783:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787135797.551787:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787135797.551792:0:6670:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787135797.551794:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787135797.551812:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.551825:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.551833:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135797.551844:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616352640:0@lo:101: 00000100:00100000:0.0:1787135797.551869:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.551929:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787135797.552025:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616352640 00000100:00100000:1.0:1787135797.552029:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616352640 00000100:00100000:3.0:1787135797.552230:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787135797.552241:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+10:6670:x1873947616352640:12345-0@lo:101: 00010000:00010000:3.0:1787135797.552252:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135797.552262:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98820e2800/0xf5850c552f2021e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2021e2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135797.552278:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98820e2800/0xf5850c552f2021e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2021e2 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135797.552286:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98820e2800/0xf5850c552f2021e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2021e2 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135797.552294:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e2800, rc 0) 00000100:00100000:3.0:1787135797.552322:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+11:6670:x1873947616352640:12345-0@lo:101: Request processed in 85us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135797.552327:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787135797.552412:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616352640:0@lo:101: 00010000:00010000:0.0:1787135797.552432:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2021e9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.552441:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2021e9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135797.552522:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616352768:0@lo:501: 00000100:00100000:0.0:1787135797.552546:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.552581:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135797.552688:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616352768 00000100:00100000:3.0:1787135797.552694:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616352768 00000100:00100000:3.0:1787135797.552756:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787135797.552765:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+11:6670:x1873947616352768:12345-0@lo:501: 00000100:00100000:3.0:1787135797.553102:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+11:6670:x1873947616352768:12345-0@lo:501: Request processed in 337us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135797.553181:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787135797.553264:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616352768:0@lo:501: 00000100:00100000:0.0:1787135797.553293:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616352896:0@lo:503: 00000100:00100000:0.0:1787135797.553332:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.553360:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135797.553411:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616352896 00000100:00100000:3.0:1787135797.553425:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616352896 00000100:00100000:3.0:1787135797.553443:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787135797.553449:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+11:6670:x1873947616352896:12345-0@lo:503: 00000100:00100000:3.0:1787135797.553750:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+11:6670:x1873947616352896:12345-0@lo:503: Request processed in 299us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135797.553756:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787135797.553864:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616352896:0@lo:503: 00000040:00080000:0.0:1787135797.554368:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787135797.554453:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353024:0@lo:502: 00000100:00100000:0.0:1787135797.554493:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.554525:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135797.554593:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616353024 00000100:00100000:3.0:1787135797.554598:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616353024 00000100:00100000:3.0:1787135797.554631:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787135797.554639:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+11:6670:x1873947616353024:12345-0@lo:502: 00000100:00100000:3.0:1787135797.554791:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+11:6670:x1873947616353024:12345-0@lo:502: Request processed in 153us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135797.554799:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787135797.554945:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353024:0@lo:502: 00000040:00080000:0.0:1787135797.555234:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1787135797.555282:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1787135797.555316:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1787135797.555364:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1787135797.555400:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1787135797.555447:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1787135797.555473:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353152:0@lo:502: 00000100:00100000:0.0:1787135797.555510:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.555535:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787135797.555712:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616353152 00000100:00100000:2.0:1787135797.555718:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616353152 00000100:00100000:2.0:1787135797.555759:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787135797.555767:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+11:6670:x1873947616353152:12345-0@lo:502: 00000100:00100000:2.0:1787135797.555911:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+11:6670:x1873947616353152:12345-0@lo:502: Request processed in 144us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135797.555918:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787135797.556080:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353152:0@lo:502: 00000040:00080000:0.0:1787135797.556280:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787135797.556290:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1787135797.557814:0:6688:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787135797.557824:0:6688:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787135797.557831:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787135797.557833:0:6688:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787135797.557840:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787135797.557869:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e9744a999c0) 00000020:00000080:3.0:1787135797.557891:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787135797.557899:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787135797.557962:0:6688:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e98735aa000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787135797.557970:0:6688:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787135797.557977:0:6688:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf5850c552f2021f7 00010000:00010000:3.0:1787135797.564037:0:6688:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787135797.564488:0:6688:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787135797.567928:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787135797.568404:0:6688:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787135797.577517:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787135797.578017:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787135797.579945:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787135797.579956:0:6688:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787135797.579963:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787135797.579965:0:6688:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787135797.579969:0:6688:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787135797.579973:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787135797.579974:0:6688:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787135797.579977:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787135797.579979:0:6688:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787135797.580025:0:6688:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787135797.580029:0:6688:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787135797.580031:0:6688:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787135797.580034:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787135797.580330:0:6670:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1787135797.580356:0:6670:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787135797.580378:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2021e9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.580391:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2021e9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135797.580421:0:6670:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e98735aa000 from 1 10000000:01000000:2.0:1787135797.580424:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787135797.580460:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.580467:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.580478:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135797.580498:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353280:0@lo:101: 00000100:00100000:2.0:1787135797.580561:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135797.580772:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984326ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787135797.580883:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616353280 00000100:00100000:3.0:1787135797.580891:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616353280 00000100:00100000:3.0:1787135797.580934:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787135797.580944:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+11:6670:x1873947616353280:12345-0@lo:101: 00010000:00010000:3.0:1787135797.580957:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135797.580970:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98820e3a00/0xf5850c552f202205 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2021fe expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135797.580993:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98820e3a00/0xf5850c552f202205 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2021fe expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135797.581016:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98820e3a00/0xf5850c552f202205 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2021fe expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135797.581025:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e3a00, rc 0) 00000100:00100000:3.0:1787135797.581099:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:6670:x1873947616353280:12345-0@lo:101: Request processed in 156us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135797.581170:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787135797.581261:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353280:0@lo:101: 00010000:00010000:0.0:1787135797.581277:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202205 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.581286:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202205 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135797.581371:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353408:0@lo:501: 00000100:00100000:0.0:1787135797.581399:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.581436:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135797.581479:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616353408 00000100:00100000:3.0:1787135797.581483:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616353408 00000100:00100000:3.0:1787135797.581512:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787135797.581519:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:6670:x1873947616353408:12345-0@lo:501: 00000100:00100000:3.0:1787135797.581939:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:6670:x1873947616353408:12345-0@lo:501: Request processed in 419us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135797.581947:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787135797.582020:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353408:0@lo:501: 00000100:00100000:0.0:1787135797.582088:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353536:0@lo:503: 00000100:00100000:0.0:1787135797.582191:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.582208:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135797.582259:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616353536 00000100:00100000:3.0:1787135797.582263:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616353536 00000100:00100000:3.0:1787135797.582294:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787135797.582301:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:6670:x1873947616353536:12345-0@lo:503: 00000100:00100000:3.0:1787135797.582523:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:6670:x1873947616353536:12345-0@lo:503: Request processed in 222us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135797.582530:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787135797.582848:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353536:0@lo:503: 00000040:00080000:0.0:1787135797.583188:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787135797.583242:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353664:0@lo:502: 00000100:00100000:0.0:1787135797.583283:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.583405:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73ea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787135797.589370:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616353664 00000100:00100000:2.0:1787135797.589385:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616353664 00000100:00100000:2.0:1787135797.589450:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787135797.589461:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:6670:x1873947616353664:12345-0@lo:502: 00000100:00100000:2.0:1787135797.589924:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:6670:x1873947616353664:12345-0@lo:502: Request processed in 464us (6639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135797.589933:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787135797.590129:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353664:0@lo:502: 00000040:00080000:0.0:1787135797.590430:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787135797.590486:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787135797.590527:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353792:0@lo:502: 00000100:00100000:0.0:1787135797.590584:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.590864:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787135797.590940:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616353792 00000100:00100000:1.0:1787135797.590947:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616353792 00000100:00100000:1.0:1787135797.590986:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787135797.590994:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:6670:x1873947616353792:12345-0@lo:502: 00000100:00100000:1.0:1787135797.591188:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:6670:x1873947616353792:12345-0@lo:502: Request processed in 195us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135797.591195:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787135797.591331:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353792:0@lo:502: 00000040:00080000:2.0:1787135797.591435:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787135797.591446:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1787135797.592289:0:6692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787135797.592300:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135797.592302:0:6692:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787135797.592309:0:6692:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e98735aa000 00000020:00000080:0.0:1787135797.592311:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787135797.592331:0:6692:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787135797.592334:0:6692:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135797.592335:0:6692:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787135797.592338:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1787135797.592462:0:6670:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1787135797.592480:0:6670:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787135797.592498:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202205 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.592516:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202205 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135797.592555:0:6670:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787135797.592558:0:6670:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e98735aa000 10000000:01000000:2.0:1787135797.592561:0:6670:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e98735aa000 10000000:01000000:2.0:1787135797.592565:0:6670:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787135797.592701:0:6670:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e98735aa000 from 1 10000000:01000000:2.0:1787135797.592703:0:6670:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787135797.592734:0:6670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.592742:0:6670:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.592752:0:6670:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135797.592831:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353920:0@lo:101: 00000100:00100000:2.0:1787135797.592882:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135797.592955:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984326ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1787135797.594748:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616353920 00000100:00100000:1.0:1787135797.594826:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616353920 00000100:00100000:1.0:1787135797.594915:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787135797.594926:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:6670:x1873947616353920:12345-0@lo:101: 00010000:00010000:1.0:1787135797.594942:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135797.594958:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841489000/0xf5850c552f202213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20220c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.594984:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841489000/0xf5850c552f202213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20220c expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.594995:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841489000/0xf5850c552f202213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20220c expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135797.595013:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841489000, rc 0) 00000100:00100000:1.0:1787135797.595103:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+13:6670:x1873947616353920:12345-0@lo:101: Request processed in 180us (2221us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135797.595120:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787135797.595207:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616353920:0@lo:101: 00010000:00010000:3.0:1787135797.595225:0:6670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202213 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135797.595234:0:6670:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202213 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135797.595345:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616354048:0@lo:501: 00000100:00100000:3.0:1787135797.595376:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135797.596384:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616354048 00000100:00100000:2.0:1787135797.596393:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616354048 00000100:00100000:2.0:1787135797.596435:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787135797.596444:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:6670:x1873947616354048:12345-0@lo:501: 00000100:00100000:2.0:1787135797.597118:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:6670:x1873947616354048:12345-0@lo:501: Request processed in 663us (1729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135797.597127:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787135797.597439:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9741084900 going to sleep for 11 seconds 00000100:00100000:2.0:1787135797.597463:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616354048:0@lo:501: 00000100:00100000:2.0:1787135797.597512:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616354176:0@lo:503: 00000100:00100000:2.0:1787135797.597556:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135797.597727:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9852ceb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135797.597915:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616354176 00000100:00100000:0.0:1787135797.597922:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616354176 00000100:00100000:0.0:1787135797.597992:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787135797.598001:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:6670:x1873947616354176:12345-0@lo:503: 00000100:00100000:0.0:1787135797.598311:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:6670:x1873947616354176:12345-0@lo:503: Request processed in 311us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135797.598325:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787135797.598392:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616354176:0@lo:503: 00000040:00080000:3.0:1787135797.598696:0:6670:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787135797.598783:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616354304:0@lo:502: 00000100:00100000:3.0:1787135797.598824:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135797.599663:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9741084f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787135797.599858:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616354304 00000100:00100000:2.0:1787135797.599865:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616354304 00000100:00100000:2.0:1787135797.599900:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787135797.599909:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:6670:x1873947616354304:12345-0@lo:502: 00000100:00100000:2.0:1787135797.600349:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:6670:x1873947616354304:12345-0@lo:502: Request processed in 439us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135797.600358:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787135797.600457:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616354304:0@lo:502: 00000040:00080000:3.0:1787135797.600897:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787135797.600952:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787135797.600989:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787135797.601082:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787135797.601201:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787135797.601257:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787135797.601294:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787135797.601328:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787135797.601376:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787135797.601411:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787135797.601467:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787135797.601518:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787135797.601553:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787135797.601586:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787135797.601897:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787135797.601935:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787135797.601979:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787135797.602033:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787135797.602098:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787135797.602139:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787135797.602216:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787135797.602254:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787135797.602289:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787135797.602336:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787135797.602372:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787135797.602403:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787135797.602456:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787135797.602487:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787135797.602529:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616354432:0@lo:502: 00000100:00100000:3.0:1787135797.602596:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135797.602747:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9741084f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787135797.602877:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616354432 00000100:00100000:0.0:1787135797.602885:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616354432 00000100:00100000:0.0:1787135797.602925:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787135797.602934:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:6670:x1873947616354432:12345-0@lo:502: 00000100:00100000:0.0:1787135797.603168:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:6670:x1873947616354432:12345-0@lo:502: Request processed in 235us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135797.603176:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787135797.603391:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd56680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616354432:0@lo:502: 00000040:00080000:3.0:1787135797.603477:0:6670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787135797.603487:0:6670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1787135797.604244:0:6693:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1787135797.604258:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e9744a9cd40) 00000020:00000080:3.0:1787135797.604276:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1787135797.604438:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e98735aa000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787135797.604443:0:6693:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e98735aa000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1787135797.604445:0:6693:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e98735aa000 3 00010000:00080000:3.0:1787135797.604478:0:6693:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8e974512c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1787135797.609405:0:6693:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1787135797.609529:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787135797.609570:0:6693:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787135797.609583:0:6693:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf5850c552f202221 00000100:00080000:2.0:1787135797.609593:0:6693:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787135797.609598:0:6693:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e974512c800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1787135797.609832:0:6693:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e98606d4000 x1873947616354560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787135797.609867:0:6693:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787135797.609934:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616354688:0@lo:400: 00000100:00100000:2.0:1787135797.609996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135797.610082:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616354688 00000100:00100000:2.0:1787135797.610089:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616354688 00000100:00100000:1.0:1787135797.610754:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1873947616354560:0@lo:38: 00000100:00100000:1.0:1787135797.610807:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135797.610851:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616354560 00000100:00100000:1.0:1787135797.610855:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616354560 00000100:00100000:1.0:1787135797.610880:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787135797.610886:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1873947616354560:12345-0@lo:38: 00010000:00080000:1.0:1787135797.610908:0:5821:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:1.0:1787135797.610949:0:5821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf5850c552f202228 00000004:00100000:1.0:1787135797.610963:0:5821:0:(mdt_handler.c:7490:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787135797.610992:0:5821:0:(import.c:65:import_set_state_nolock()) ffff8e98533e1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787135797.611035:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873947616354560:12345-0@lo:38: Request processed in 148us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135797.611042:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787135797.611099:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e98606d4000 x1873947616354560/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787135807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135797.611121:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787135797.611127:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787135797.611134:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787135797.611138:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787135797.611141:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e974512c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787135797.611147:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1873947616354560:0@lo:38: 00000100:00100000:2.0:1787135797.611367:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787135797.611376:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616354688:12345-0@lo:400: 00000100:00100000:2.0:1787135797.611441:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616354688:12345-0@lo:400: Request processed in 67us (1445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135797.611448:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787135797.611474:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e98606d5c00 x1873947616354688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135813 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135797.611484:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616354688:0@lo:400: 00000040:00080000:2.0:1787135797.613392:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1787135797.613471:0:6670:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787135797.613493:0:6670:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787135797.613709:0:6670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202213 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.613722:0:6670:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202213 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787135797.613833:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787135797.613836:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787135797.613837:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787135797.613838:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787135797.613839:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787135797.613841:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787135797.613842:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787135797.613843:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787135797.613845:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787135797.613847:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787135797.613848:0:6670:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787135797.613852:0:6670:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787135797.613854:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787135797.613855:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787135797.613857:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787135797.613857:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787135797.613858:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787135797.613865:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787135797.613866:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787135797.613867:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787135797.613868:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787135797.613869:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787135797.613870:0:6670:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787135797.613893:0:6670:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787135797.613909:0:6670:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616354816:0@lo:253: 00000100:00100000:2.0:1787135797.613967:0:6670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135797.614006:0:6670:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9847c27540 going to sleep for 11 seconds 00000100:00100000:0.0:1787135797.614208:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616354816 00000100:00100000:0.0:1787135797.614215:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616354816 00000100:00100000:0.0:1787135797.614253:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787135797.614261:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:6670:x1873947616354816:12345-0@lo:253: 20000000:01000000:0.0:1787135797.614283:0:5816:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787135797.614296:0:5816:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787135797.641174:0:5816:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787135797.641197:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787135797.641307:0:5837:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787135797.641313:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787135797.641335:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.641354:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9840030400/0xf5850c552f20218e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202187 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.641364:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.641406:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9840030400/0xf5850c552f20218e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f202187 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135797.641450:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9840030400/0xf5850c552f20218e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f202187 expref: 13 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135797.641468:0:5837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1873947616354944:0@lo:104: 00000100:00100000:2.0:1787135797.641538:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135797.641594:0:5837:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9860457a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787135797.641662:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616354944 00000100:00100000:0.0:1787135797.641669:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616354944 00000100:00100000:0.0:1787135797.641719:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787135797.641727:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:5837:x1873947616354944:12345-0@lo:104: 00010000:00010000:0.0:1787135797.641740:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f202187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20218e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.641803:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787135797.641809:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:5837:x1873947616354944:12345-0@lo:104: Request processed in 83us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135797.641817:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787135797.641853:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787135797.641869:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f202187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20218e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.641876:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cb400 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:0.0:1787135797.641880:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f202187 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f20218e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.641888:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f202187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f20218e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787135797.641895:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f202187 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f20218e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135797.641901:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787135797.641928:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f202187 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20218e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.641934:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787135797.641951:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f202187 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20218e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.641957:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f202187 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20218e expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.641972:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135797.641974:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135797.641976:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135797.641993:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616355072:0@lo:103: 00000100:00100000:0.0:1787135797.642026:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135797.642091:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616355072 00000100:00100000:0.0:1787135797.642096:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616355072 00010000:00010000:0.0:1787135797.642131:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9840030400/0xf5850c552f20218e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202187 expref: 14 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135797.642155:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787135797.642163:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+14:3301:x1873947616355072:12345-0@lo:103: 00010000:00010000:0.0:1787135797.642172:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135797.642177:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9840030400/0xf5850c552f20218e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202187 expref: 14 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642188:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9840030400/0xf5850c552f20218e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f202187 expref: 14 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642205:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642213:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787135797.642226:0:5808:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001137065s 00010000:00010000:0.0:1787135797.642230:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642236:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642242:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642249:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642254:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cba00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787135797.642265:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642273:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642282:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642292:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135797.642321:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432c0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+14:3301:x1873947616355072:12345-0@lo:103: Request processed in 159us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135797.642327:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787135797.642380:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616355072:0@lo:103: 00010000:00010000:0.0:1787135797.642408:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9840030400/0xf5850c552f20218e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f202187 expref: 13 pid: 5815 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135797.642432:0:5837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1873947616354944:0@lo:104: 00010000:00010000:0.0:1787135797.642443:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642453:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642458:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135797.642463:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98413cba00/0xf5850c552f20222f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135797.655866:0:6670:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:6670:1873947616354816:0@lo:253: 10000000:01000000:2.0:1787135797.655886:0:6670:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787135797.655902:0:6670:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787135797.655904:0:6670:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787135797.655905:0:6670:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787135797.655906:0:6670:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787135797.655907:0:6670:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787135797.655908:0:6670:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787135797.655910:0:6670:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787135797.655911:0:6670:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787135797.655912:0:6670:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787135797.655914:0:6670:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787135797.655915:0:6670:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787135797.655929:0:6670:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1787135797.656748:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:6670:x1873947616354816:12345-0@lo:253: Request processed in 41488us (41781us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135797.656783:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00080000:10000000:3.0:1787135797.664986:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787135797.665234:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787135797.665794:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787135797.665993:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787135797.666438:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787135797.666868:0:6670:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787135797.668398:0:6670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787135797.920751:0:6670:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787135797.920759:0:6670:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787135797.920792:0:6670:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787135797.920852:0:6670:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787135797.920868:0:6670:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787135797.920897:0:6670:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:0.0:1787135798.232296:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787135798.232303:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e98456a5800 from 21 10000000:01000000:0.0:1787135798.232308:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787135798.232351:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135798.232361:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135798.232371:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135798.232393:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616355200:0@lo:101: 00000100:00100000:0.0:1787135798.232463:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135798.232529:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874107d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787135798.233209:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616355200 00000100:00100000:1.0:1787135798.233219:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616355200 00000100:00100000:1.0:1787135798.233281:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787135798.233291:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:5818:x1873947616355200:12345-0@lo:101: 00010000:00010000:1.0:1787135798.233304:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135798.233319:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841488400/0xf5850c552f20223d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202236 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.233345:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841488400/0xf5850c552f20223d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202236 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.233356:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841488400/0xf5850c552f20223d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202236 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.233364:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841488400, rc 0) 00000100:00100000:1.0:1787135798.233427:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616355200:12345-0@lo:101: Request processed in 138us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135798.233434:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787135798.233974:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616355200:0@lo:101: 00010000:00010000:0.0:1787135798.233992:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20223d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135798.234002:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20223d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135798.234089:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616355328:0@lo:501: 00000100:00100000:0.0:1787135798.234143:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135798.234171:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874107d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787135798.234357:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616355328 00000100:00100000:1.0:1787135798.234363:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616355328 00000100:00100000:1.0:1787135798.234399:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787135798.234407:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616355328:12345-0@lo:501: 00000100:00100000:1.0:1787135798.234677:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616355328:12345-0@lo:501: Request processed in 270us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135798.234684:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787135798.234719:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616355328:0@lo:501: 00000100:00100000:1.0:1787135798.234750:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616355456:0@lo:503: 00000100:00100000:1.0:1787135798.234795:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135798.234820:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98533696c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135798.234847:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616355456 00000100:00100000:3.0:1787135798.234857:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616355456 00000100:00100000:3.0:1787135798.234886:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787135798.234893:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616355456:12345-0@lo:503: 00000100:00100000:3.0:1787135798.235113:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616355456:12345-0@lo:503: Request processed in 220us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135798.235119:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787135798.235621:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874979f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616355456:0@lo:503: 00000100:00100000:0.0:1787135798.237860:0:6714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:6714:1873947616355584:0@lo:502: 00000100:00100000:0.0:1787135798.237938:0:6714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135798.237984:0:6714:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98741070c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135798.238031:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616355584 00000100:00100000:2.0:1787135798.238038:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616355584 00000100:00100000:2.0:1787135798.238122:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787135798.238131:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:6714:x1873947616355584:12345-0@lo:502: 00000100:00100000:2.0:1787135798.238580:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:6714:x1873947616355584:12345-0@lo:502: Request processed in 449us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135798.238588:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787135798.238887:0:6714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:6714:1873947616355584:0@lo:502: 00000100:00100000:0.0:1787135798.238938:0:6714:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:6714:1873947616355712:0@lo:502: 00000100:00100000:0.0:1787135798.238976:0:6714:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135798.238996:0:6714:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98741070c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135798.239071:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616355712 00000100:00100000:1.0:1787135798.239077:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616355712 00000100:00100000:1.0:1787135798.239117:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787135798.239124:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:6714:x1873947616355712:12345-0@lo:502: 00000100:00100000:1.0:1787135798.239504:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:6714:x1873947616355712:12345-0@lo:502: Request processed in 380us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135798.239512:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787135798.239596:0:6714:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:6714:1873947616355712:0@lo:502: 00000040:00080000:0.0:1787135798.239617:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787135798.239790:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787135798.239811:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787135798.239823:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20223d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.239835:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20223d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787135798.239845:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787135798.239848:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e98456a5800 from 4 10000000:01000000:1.0:1787135798.239850:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787135798.239879:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.239887:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.239896:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135798.239910:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616355840:0@lo:101: 00000100:00100000:1.0:1787135798.239946:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135798.239980:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9853369000 going to sleep for 11 seconds 00000100:00100000:0.0:1787135798.240027:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616355840 00000100:00100000:0.0:1787135798.240032:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616355840 00000100:00100000:0.0:1787135798.240086:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787135798.240094:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616355840:12345-0@lo:101: 00010000:00010000:0.0:1787135798.240114:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135798.240128:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9840031400/0xf5850c552f20224b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202244 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135798.240148:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9840031400/0xf5850c552f20224b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202244 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135798.240158:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9840031400/0xf5850c552f20224b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202244 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135798.240167:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9840031400, rc 0) 00000100:00100000:0.0:1787135798.240222:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616355840:12345-0@lo:101: Request processed in 129us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135798.240228:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787135798.240616:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616355840:0@lo:101: 00010000:00010000:1.0:1787135798.240629:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20224b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.240638:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20224b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135798.240683:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616355968:0@lo:256: 00000100:00100000:1.0:1787135798.240715:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135798.240743:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9853369000 going to sleep for 11 seconds 00000100:00100000:2.0:1787135798.240815:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616355968 00000100:00100000:2.0:1787135798.240819:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616355968 00000100:00100000:2.0:1787135798.240855:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787135798.240862:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616355968:12345-0@lo:256: 20000000:01000000:2.0:1787135798.240877:0:5815:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787135798.240892:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787135798.240895:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1787135798.240974:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616355968:12345-0@lo:256: Request processed in 112us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135798.240981:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787135798.241079:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616355968:0@lo:256: 10000000:01000000:1.0:1787135798.241340:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787135798.241348:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20224b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.241358:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20224b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787135798.241365:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787135798.241368:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787135798.241370:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787135798.241391:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.241398:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.241429:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135798.241444:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616356096:0@lo:101: 00000100:00100000:1.0:1787135798.241472:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135798.241998:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9853369000 going to sleep for 11 seconds 00000100:00100000:2.0:1787135798.242921:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616356096 00000100:00100000:2.0:1787135798.242931:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616356096 00000100:00100000:1.0:1787135798.243073:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787135798.243083:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616356096:12345-0@lo:101: 00010000:00010000:1.0:1787135798.243108:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135798.243125:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841488a00/0xf5850c552f202259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202252 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.243147:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841488a00/0xf5850c552f202259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202252 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.243157:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841488a00/0xf5850c552f202259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202252 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.243165:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841488a00, rc 0) 00000100:00100000:1.0:1787135798.243235:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616356096:12345-0@lo:101: Request processed in 153us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135798.243246:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787135798.243295:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616356096:0@lo:101: 00010000:00010000:1.0:1787135798.243311:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202259 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135798.243320:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202259 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135798.243383:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616356224:0@lo:501: 00000100:00100000:1.0:1787135798.243419:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135798.243446:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9853369000 going to sleep for 11 seconds 00000100:00100000:0.0:1787135798.243566:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616356224 00000100:00100000:0.0:1787135798.243572:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616356224 00000100:00100000:0.0:1787135798.243606:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787135798.243613:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616356224:12345-0@lo:501: 00000100:00100000:0.0:1787135798.243930:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616356224:12345-0@lo:501: Request processed in 316us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135798.243937:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787135798.244162:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616356224:0@lo:501: 00000100:00100000:1.0:1787135798.244205:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616356352:0@lo:503: 00000100:00100000:1.0:1787135798.244240:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135798.244261:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9853369000 going to sleep for 11 seconds 00000100:00100000:1.0:1787135798.244272:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616356352 00000100:00100000:1.0:1787135798.244275:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616356352 00000100:00100000:1.0:1787135798.244297:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787135798.244302:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616356352:12345-0@lo:503: 00000100:00100000:1.0:1787135798.244499:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616356352:12345-0@lo:503: Request processed in 195us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135798.244506:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787135798.244542:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616356352:0@lo:503: 00000100:00100000:0.0:1787135798.246585:0:6715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:6715:1873947616356480:0@lo:502: 00000100:00100000:0.0:1787135798.246668:0:6715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135798.246718:0:6715:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874107d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787135798.246780:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616356480 00000100:00100000:1.0:1787135798.246787:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616356480 00000100:00100000:1.0:1787135798.246832:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787135798.246840:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+15:6715:x1873947616356480:12345-0@lo:502: 00000100:00100000:1.0:1787135798.247146:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+15:6715:x1873947616356480:12345-0@lo:502: Request processed in 306us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135798.247154:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787135798.247325:0:6715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:6715:1873947616356480:0@lo:502: 00000020:01000000:2.0:1787135798.247636:0:6715:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787135798.247644:0:6715:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787135798.247651:0:6715:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787135798.247653:0:6715:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787135798.247663:0:6715:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787135798.247667:0:6715:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:2.0:1787135798.247687:0:6715:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787135798.247690:0:6715:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787135798.247703:0:6715:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e9851eeb380) 00000020:00000080:2.0:1787135798.247721:0:6715:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787135798.247726:0:6715:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787135798.247790:0:6715:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787135798.247794:0:6715:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787135798.247800:0:6715:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f202267 00010000:00080000:2.0:1787135798.247824:0:6715:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8e9881f43800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1787135798.248028:0:6715:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1787135798.300933:0:6715:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787135798.300956:0:6715:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787135798.301732:0:6715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787135798.301918:0:6715:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787135798.301965:0:6715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1787135798.302025:0:6715:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787135798.304209:0:6718:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787135798.304218:0:6718:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787135798.306602:0:6715:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787135798.306617:0:6715:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787135798.306654:0:6715:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787135798.306675:0:6715:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5850c552f20226e 00000100:00080000:0.0:1787135798.306685:0:6715:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787135798.306691:0:6715:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e9881f43800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1787135798.306727:0:6715:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e987bd37480 x1873947616356608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787135798.306755:0:6715:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787135798.306810:0:6715:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787135798.306814:0:6715:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135798.306816:0:6715:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787135798.306818:0:6715:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787135798.306827:0:6715:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135798.306828:0:6715:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787135798.306831:0:6715:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787135798.306832:0:6715:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787135798.306857:0:6715:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:6715:1873947616356736:0@lo:502: 00000100:00100000:0.0:1787135798.306925:0:6715:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135798.306967:0:6715:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874107a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135798.307078:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616356608:0@lo:8: 00000100:00100000:3.0:1787135798.307127:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135798.307199:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616356864:0@lo:400: 00000100:00100000:3.0:1787135798.307230:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135798.307251:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787135798.307257:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616356992:0@lo:400: 00000100:00100000:3.0:1787135798.307296:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135798.307332:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616356864 00000100:00100000:3.0:1787135798.307338:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616356864 00000100:00100000:3.0:1787135798.307374:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616356992 00000100:00100000:3.0:1787135798.307377:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616356992 00000100:00100000:3.0:1787135798.307400:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787135798.307420:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616356864:12345-0@lo:400: 00000100:00100000:3.0:1787135798.307470:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616356864:12345-0@lo:400: Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135798.307478:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787135798.307492:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787135798.307499:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616356992:12345-0@lo:400: 00000100:00100000:3.0:1787135798.307523:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616356992:12345-0@lo:400: Request processed in 26us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135798.307529:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787135798.307556:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787135798.307581:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e987bd54700 x1873947616356992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135798.307594:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616356992:0@lo:400: 00010000:00080000:3.0:1787135798.307605:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e987bd55500 x1873947616356864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135798.307612:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616356864:0@lo:400: 00000100:00100000:0.0:1787135798.307749:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616356608 00000100:00100000:0.0:1787135798.307754:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616356608 00000100:00100000:0.0:1787135798.307782:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787135798.307786:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3299:x1873947616356608:12345-0@lo:8: 00010000:00080000:0.0:1787135798.307804:0:6672:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:0.0:1787135798.307826:0:6672:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5850c552f202275 00002000:00100000:0.0:1787135798.307856:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e9744a90800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113908 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787135798.307861:0:6672:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787135798.307864:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787135798.307979:0:6672:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787135798.308150:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787135798.308173:0:6672:0:(import.c:65:import_set_state_nolock()) ffff8e9744a93800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787135798.308216:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3299:x1873947616356608:12345-0@lo:8: Request processed in 428us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135798.308223:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787135798.308348:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff8e987bd37480 x1873947616356608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787135808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135798.308357:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787135798.308365:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787135798.308372:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787135798.308377:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787135798.308379:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e9881f43800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787135798.308393:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787135798.308398:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616356608:0@lo:8: 00000004:00080000:0.0:1787135798.308457:0:6718:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1787135798.308551:0:6718:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 158251502084ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787135798.308755:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616356736 00000100:00100000:2.0:1787135798.308761:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616356736 00000100:00100000:2.0:1787135798.308797:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787135798.308805:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+15:6715:x1873947616356736:12345-0@lo:502: 00000100:00100000:2.0:1787135798.309298:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+15:6715:x1873947616356736:12345-0@lo:502: Request processed in 493us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135798.309305:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787135798.309364:0:6715:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd34a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:6715:1873947616356736:0@lo:502: 00000020:01000000:2.0:1787135798.309394:0:6715:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787135798.309401:0:6715:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787135798.309403:0:6715:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787135798.309417:0:6715:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787135798.309526:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787135798.309549:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787135798.309558:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202259 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135798.309569:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202259 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135798.309579:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787135798.309581:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8e9860760000 from 1 10000000:01000000:2.0:1787135798.309584:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787135798.309609:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135798.309616:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135798.309626:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135798.309641:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616357120:0@lo:101: 00000100:00100000:2.0:1787135798.309675:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135798.309706:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9860457b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787135798.309721:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616357120 00000100:00100000:2.0:1787135798.309724:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616357120 00000100:00100000:2.0:1787135798.309744:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787135798.309750:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616357120:12345-0@lo:101: 00010000:00010000:2.0:1787135798.309761:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135798.309772:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98413cba00/0xf5850c552f202283 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20227c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135798.309802:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98413cba00/0xf5850c552f202283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20227c expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135798.309812:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98413cba00/0xf5850c552f202283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20227c expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135798.309820:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98413cba00, rc 0) 00000100:00100000:2.0:1787135798.309844:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616357120:12345-0@lo:101: Request processed in 95us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135798.309850:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787135798.309876:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616357120:0@lo:101: 00010000:00010000:2.0:1787135798.309887:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202283 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135798.309896:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202283 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135798.309928:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616357248:0@lo:501: 00000100:00100000:2.0:1787135798.309946:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135798.309956:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874107240 going to sleep for 11 seconds 00000100:00100000:2.0:1787135798.309964:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616357248 00000100:00100000:2.0:1787135798.309968:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616357248 00000100:00100000:2.0:1787135798.309985:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787135798.309990:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616357248:12345-0@lo:501: 00000100:00100000:2.0:1787135798.310235:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616357248:12345-0@lo:501: Request processed in 243us (287us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787135798.310243:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787135798.310282:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616357248:0@lo:501: 10000000:01000000:2.0:1787135798.310301:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787135798.310307:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202283 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135798.310314:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202283 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787135798.340654:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1787135798.361948:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787135798.378675:0:6719:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787135798.378705:0:6719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6719:1873947616357504:0@lo:7: 00000100:00100000:2.0:1787135798.378774:0:6719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135798.378822:0:6719:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843397d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787135798.378854:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616357376:0@lo:13: 00000100:00100000:2.0:1787135798.378880:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135798.378966:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616357504 00000100:00100000:3.0:1787135798.378974:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616357504 00000100:00100000:3.0:1787135798.379032:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787135798.379041:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6719:x1873947616357504:12345-0@lo:7: 00000100:00080000:2.0:1787135798.381456:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787135798.384943:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616357376 00000100:00100000:0.0:1787135798.384955:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616357376 00000100:00100000:0.0:1787135798.385007:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787135798.385016:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1873947616357376:12345-0@lo:13: 00002000:00000024:0.0:1787135798.385073:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:0.0:1787135798.385485:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1873947616357376:12345-0@lo:13: Request processed in 469us (6602us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135798.385492:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787135798.385568:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e98606d5c00 x1873947616357376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135798.385589:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616357376:0@lo:13: 00002000:00080000:3.0:1787135798.389333:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787135798.389341:0:6674:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787135798.389433:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6719:x1873947616357504:12345-0@lo:7: Request processed in 10390us (10655us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135798.389443:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787135798.389574:0:6719:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e98606d7800 x1873947616357504/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787135814 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135798.389589:0:6719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6719:1873947616357504:0@lo:7: 00000004:00080000:1.0:1787135798.389602:0:6719:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787135798.389639:0:6719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6719:1873947616357632:0@lo:5: 00000100:00100000:1.0:1787135798.389674:0:6719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135798.389716:0:6719:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9846184840 going to sleep for 11 seconds 00000100:00100000:3.0:1787135798.389777:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616357632 00000100:00100000:3.0:1787135798.389790:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616357632 00000100:00100000:3.0:1787135798.389833:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787135798.389841:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6719:x1873947616357632:12345-0@lo:5: 00002000:00080000:3.0:1787135798.389864:0:6673:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787135798.389867:0:6673:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787135798.390248:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874979500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6719:x1873947616357632:12345-0@lo:5: Request processed in 407us (572us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787135798.390255:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787135798.390287:0:6719:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987497a680 x1873947616357632/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787135814 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135798.390300:0:6719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6719:1873947616357632:0@lo:5: 00000004:00080000:3.0:1787135798.390309:0:6719:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1787135798.390333:0:6719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd55500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6719:1873947616357760:0@lo:700: 00000100:00100000:3.0:1787135798.390357:0:6719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135798.390374:0:6719:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f80600 going to sleep for 11 seconds 00000100:00100000:3.0:1787135798.390390:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616357760 00000100:00100000:3.0:1787135798.390394:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616357760 00000100:00100000:3.0:1787135798.390519:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787135798.390527:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6719:x1873947616357760:12345-0@lo:700: 00000100:00100000:3.0:1787135798.390554:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6681:1873947616357888:0@lo:700: 00000100:00100000:3.0:1787135798.390581:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135798.390598:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f80d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135798.390616:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616357888 00000100:00100000:3.0:1787135798.390619:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616357888 00000100:00100000:3.0:1787135798.390645:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787135798.390652:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6681:x1873947616357888:12345-0@lo:700: 40000000:02000000:2.0:1787135798.416307:0:5828:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787135798.421258:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6681:x1873947616357888:12345-0@lo:700: Request processed in 30597us (30666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135798.421278:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787135798.421368:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd55c00 x1873947616357888/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787135814 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135798.421384:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd55c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6681:1873947616357888:0@lo:700: 40000000:02000000:3.0:1787135798.421398:0:6681:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1787135798.505337:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6719:x1873947616357760:12345-0@lo:700: Request processed in 114803us (114971us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135798.505352:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:3.0:1787135798.505383:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787135798.505398:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:3.0:1787135798.505446:0:6719:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd55500 x1873947616357760/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787135814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135798.505461:0:6719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd55500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6719:1873947616357760:0@lo:700: 00000004:02000040:1.0:1787135798.544195:0:6719:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787135798.555899:0:6719:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874978700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6719:1873947616358016:0@lo:5: 00000100:00100000:1.0:1787135798.555961:0:6719:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135798.556007:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616358016 00000100:00100000:1.0:1787135798.556014:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616358016 00000100:00100000:1.0:1787135798.556082:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787135798.556091:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6719:x1873947616358016:12345-0@lo:5: 00000100:00100000:0.0:1787135798.562191:0:6719:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9846184900 going to sleep for 11 seconds 00002000:00080000:1.0:1787135798.566715:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1787135798.566738:0:6674:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1787135798.571757:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6719:x1873947616358016:12345-0@lo:5: Request processed in 15661us (15790us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1787135798.571769:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787135798.572474:0:6719:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9874978700 x1873947616358016/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787135814 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135798.572487:0:6719:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787135798.572503:0:6719:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8e9874978700 x1873947616358016/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787135814 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135798.572512:0:6719:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874978700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6719:1873947616358016:0@lo:5: 00000004:00080000:0.0:1787135798.572525:0:6719:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1787135799.390103:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135800.409207:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135801.433629:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135802.458637:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135803.355089:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616358528:0@lo:400: 00000100:00100000:3.0:1787135803.355151:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135803.355198:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787135803.355203:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616358144:0@lo:400: 00000100:00100000:3.0:1787135803.355229:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135803.355256:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616358272:0@lo:400: 00000100:00100000:3.0:1787135803.355278:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135803.355293:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787135803.355297:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616358400:0@lo:400: 00000100:00100000:3.0:1787135803.355314:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135803.355338:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616358272 00000100:00100000:3.0:1787135803.355345:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616358272 00000100:00100000:3.0:1787135803.355401:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616358400 00000100:00100000:3.0:1787135803.355404:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616358400 00000100:00100000:3.0:1787135803.355432:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787135803.355440:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616358272:12345-0@lo:400: 00000100:00100000:3.0:1787135803.355487:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616358272:12345-0@lo:400: Request processed in 47us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135803.355495:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787135803.355509:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787135803.355516:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616358400:12345-0@lo:400: 00000100:00100000:3.0:1787135803.355542:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616358400:12345-0@lo:400: Request processed in 28us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135803.355548:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1787135803.355571:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787135803.355595:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd56a00 x1873947616358400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135803.355609:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616358400:0@lo:400: 00010000:00080000:3.0:1787135803.355620:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd55c00 x1873947616358272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135803.355627:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616358272:0@lo:400: 00000100:00100000:1.0:1787135803.358470:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616358528 00000100:00100000:1.0:1787135803.358482:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616358528 00000100:00100000:1.0:1787135803.358561:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787135803.358572:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1873947616358528:12345-0@lo:400: 00000100:00100000:1.0:1787135803.358674:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1873947616358528:12345-0@lo:400: Request processed in 104us (3521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135803.358681:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1787135803.358704:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787135803.358739:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd57480 x1873947616358528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135803.358756:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616358528:0@lo:400: 00000100:00100000:2.0:1787135803.358866:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616358144 00000100:00100000:2.0:1787135803.358872:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616358144 00000100:00100000:2.0:1787135803.358901:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787135803.358909:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:3300:x1873947616358144:12345-0@lo:400: 00000100:00100000:2.0:1787135803.358950:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:3300:x1873947616358144:12345-0@lo:400: Request processed in 42us (3719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135803.358966:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787135803.360551:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616358144:0@lo:400: 00010000:00010000:3.0:1787135803.487220:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135803.869085:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616358656:0@lo:13: 00000100:00100000:1.0:1787135803.869159:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135803.869703:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616358656 00000100:00100000:1.0:1787135803.869711:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616358656 00000100:00100000:1.0:1787135803.869756:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787135803.869765:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616358656:12345-0@lo:13: 00002000:00000024:1.0:1787135803.869798:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135803.870139:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874978000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616358656:12345-0@lo:13: Request processed in 80us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135803.870149:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787135803.870196:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd35880 x1873947616358656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135803.870214:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616358656:0@lo:13: 00000001:00080000:0.0:1787135804.015424:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:2.0:1787135804.162335:0:7042:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787135804.505892:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135805.530677:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135806.552218:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135807.578676:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135808.477865:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616358784:0@lo:400: 00000100:00100000:3.0:1787135808.477938:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135808.477998:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787135808.478005:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616358912:0@lo:400: 00000100:00100000:3.0:1787135808.478093:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135808.478129:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616358912 00000100:00100000:3.0:1787135808.478137:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616358912 00000100:00100000:3.0:1787135808.478179:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787135808.478189:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616358912:12345-0@lo:400: 00000100:00100000:3.0:1787135808.478238:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616358912:12345-0@lo:400: Request processed in 50us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135808.478245:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787135808.478296:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd36d80 x1873947616358912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135808.478309:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616358912:0@lo:400: 00000100:00100000:0.0:1787135808.478401:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616358784 00000100:00100000:0.0:1787135808.478406:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616358784 00000100:00100000:0.0:1787135808.478440:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787135808.478448:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+16:3302:x1873947616358784:12345-0@lo:400: 00000100:00100000:0.0:1787135808.478486:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+16:3302:x1873947616358784:12345-0@lo:400: Request processed in 39us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135808.478492:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787135808.478610:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616358784:0@lo:400: 00000100:00100000:0.0:1787135808.479206:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616359040:0@lo:400: 00000100:00100000:0.0:1787135808.479256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135808.479283:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787135808.479289:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616359168:0@lo:400: 00000100:00100000:0.0:1787135808.479313:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135808.479670:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616359168 00000100:00100000:1.0:1787135808.479678:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616359168 00000100:00100000:1.0:1787135808.479738:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787135808.479747:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616359168:12345-0@lo:400: 00000100:00100000:1.0:1787135808.479807:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616359168:12345-0@lo:400: Request processed in 61us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135808.479813:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787135808.480017:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787135808.480184:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd35500 x1873947616359168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135808.480195:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787135808.480208:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616359168:0@lo:400: 00000100:00100000:3.0:1787135808.480387:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616359040 00000100:00100000:3.0:1787135808.480392:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616359040 00000100:00100000:3.0:1787135808.480498:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787135808.480507:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616359040:12345-0@lo:400: 00000100:00100000:3.0:1787135808.480556:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616359040:12345-0@lo:400: Request processed in 51us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135808.480562:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1787135808.480592:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd36680 x1873947616359040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135824 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135808.480601:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616359040:0@lo:400: 00000100:00080000:0.0:1787135808.482787:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787135808.600375:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135808.988175:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616359296:0@lo:13: 00000100:00100000:3.0:1787135808.988250:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135808.988396:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616359296 00000100:00100000:3.0:1787135808.988419:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616359296 00000100:00100000:3.0:1787135808.988470:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787135808.988479:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616359296:12345-0@lo:13: 00002000:00000024:3.0:1787135808.988511:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135808.988554:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616359296:12345-0@lo:13: Request processed in 77us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135808.988562:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787135808.988615:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd36680 x1873947616359296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135808.988634:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616359296:0@lo:13: 00010000:00010000:3.0:1787135809.624243:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135810.648238:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135811.672611:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135812.696283:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135813.594505:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616359808:0@lo:400: 00000100:00100000:2.0:1787135813.594577:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135813.594638:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787135813.594645:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616359424:0@lo:400: 00000100:00100000:0.0:1787135813.594780:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616359808 00000100:00100000:0.0:1787135813.594788:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616359808 00000100:00100000:0.0:1787135813.594842:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787135813.594853:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616359808:12345-0@lo:400: 00000100:00100000:0.0:1787135813.594905:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616359808:12345-0@lo:400: Request processed in 54us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135813.594912:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1787135813.594933:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787135813.594987:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1787135813.595041:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd35880 x1873947616359808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135813.595083:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616359808:0@lo:400: 00000100:00100000:2.0:1787135813.595124:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616359552:0@lo:400: 00000100:00100000:2.0:1787135813.595151:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135813.595171:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787135813.595177:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616359680:0@lo:400: 00000100:00100000:2.0:1787135813.595205:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135813.595233:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616359552 00000100:00100000:2.0:1787135813.595237:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616359552 00000100:00100000:2.0:1787135813.595265:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616359680 00000100:00100000:2.0:1787135813.595267:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616359680 00000100:00100000:2.0:1787135813.595289:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787135813.595295:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616359552:12345-0@lo:400: 00000100:00100000:2.0:1787135813.595358:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616359552:12345-0@lo:400: Request processed in 63us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135813.595364:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787135813.595376:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787135813.595382:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616359680:12345-0@lo:400: 00000100:00100000:2.0:1787135813.595405:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616359680:12345-0@lo:400: Request processed in 24us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135813.595410:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787135813.595428:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787135813.595444:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd36d80 x1873947616359680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135813.595453:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616359680:0@lo:400: 00010000:00080000:2.0:1787135813.595462:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd34380 x1873947616359552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135813.595471:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616359552:0@lo:400: 00000100:00100000:0.0:1787135813.595738:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616359424 00000100:00100000:0.0:1787135813.595743:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616359424 00000100:00100000:0.0:1787135813.595778:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787135813.595784:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+16:3302:x1873947616359424:12345-0@lo:400: 00000100:00100000:0.0:1787135813.595826:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+16:3302:x1873947616359424:12345-0@lo:400: Request processed in 41us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135813.595833:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787135813.596138:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616359424:0@lo:400: 00010000:00010000:3.0:1787135813.720218:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135814.104980:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616359936:0@lo:13: 00000100:00100000:1.0:1787135814.105077:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135814.105419:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616359936 00000100:00100000:3.0:1787135814.105428:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616359936 00000100:00100000:3.0:1787135814.105564:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787135814.105576:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616359936:12345-0@lo:13: 00002000:00000024:3.0:1787135814.105656:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135814.105716:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616359936:12345-0@lo:13: Request processed in 143us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135814.105723:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787135814.105793:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd34a80 x1873947616359936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135814.105813:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616359936:0@lo:13: 00010000:00010000:2.0:1787135814.744362:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787135815.719511:0:7606:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787135815.719517:0:7606:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787135815.719677:0:7606:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e9744a91800 00000020:01000004:0.0:1787135815.719699:0:7606:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787135815.719721:0:7606:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787135815.719749:0:7606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e987c3fb380) 00000020:00000080:0.0:1787135815.719770:0:7606:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787135815.744520:0:7606:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787135815.744825:0:7606:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:0.0:1787135815.769279:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787135815.779629:0:7606:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787135815.786772:0:7606:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787135815.786814:0:7606:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787135815.786887:0:7606:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787135815.786918:0:7606:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787135815.788403:0:7606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787135815.788421:0:7606:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787135815.788495:0:7606:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf5850c552f202291 00000020:01000004:3.0:1787135815.788506:0:7606:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787135815.788536:0:7606:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787135815.788542:0:7606:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787135815.788550:0:7606:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787135815.788582:0:7606:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787135815.788588:0:7606:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787135815.813953:0:7606:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787135815.814239:0:7606:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.138@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787135815.814327:0:7606:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787135815.814329:0:7606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787135815.814331:0:7606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787135815.814332:0:7606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787135815.814333:0:7606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787135815.814335:0:7606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787135815.814342:0:7606:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787135815.814344:0:7606:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787135815.814345:0:7606:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787135815.814347:0:7606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787135815.814348:0:7606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787135815.814353:0:7606:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787135815.814356:0:7606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787135815.814357:0:7606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787135815.814358:0:7606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787135815.814359:0:7606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787135815.814360:0:7606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787135815.814361:0:7606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787135815.814362:0:7606:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787135815.814364:0:7606:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787135815.814364:0:7606:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787135815.814365:0:7606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787135815.814366:0:7606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787135815.814404:0:7606:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787135815.814426:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616360064:0@lo:253: 00000100:00100000:2.0:1787135815.814518:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.814655:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98432549c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135815.814740:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616360064 00000100:00100000:3.0:1787135815.814750:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616360064 00000100:00100000:3.0:1787135815.814847:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787135815.814857:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:7606:x1873947616360064:12345-0@lo:253: 20000000:01000000:3.0:1787135815.814892:0:5815:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1787135815.814897:0:5815:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1787135815.814903:0:5815:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1787135815.814908:0:5815:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1787135815.816788:0:5815:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787135815.817414:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1787135815.817433:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1787135815.817485:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1787135815.817494:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1787135815.817525:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787135815.817602:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787135815.818219:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787135815.818329:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:3.0:1787135815.818332:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:3.0:1787135815.818376:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787135815.818384:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787135815.818431:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787135815.818440:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:3.0:1787135815.818485:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787135815.818496:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787135815.818527:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787135815.818578:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787135815.820536:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787135815.820578:0:5815:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.138@tcp 20000000:01000000:3.0:1787135815.820580:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.138@tcp (null) (null) (null) 00000040:00080000:3.0:1787135815.820646:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787135815.820654:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787135815.820680:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787135815.820689:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.138@tcp (null) (null) 00000040:00080000:3.0:1787135815.820714:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787135815.820722:0:5815:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787135815.820766:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787135815.820798:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787135815.820817:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787135815.820820:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787135815.820828:0:5815:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787135815.820829:0:5815:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787135815.820832:0:5815:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787135815.820846:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787135815.820849:0:5815:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787135815.820888:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787135815.820891:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787135815.821835:0:7608:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787135815.821907:0:7608:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787135815.821959:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787135815.822785:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787135815.822836:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787135815.822910:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787135815.822924:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787135815.822927:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787135815.823737:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787135815.824333:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787135815.824379:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787135815.824467:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787135815.824491:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787135815.824494:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787135815.827403:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787135815.827524:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787135815.827585:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1787135815.828633:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1787135815.828688:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1787135815.828725:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1787135815.828744:0:5815:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787135815.828748:0:5815:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787135815.831445:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1787135815.831587:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1787135815.831624:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787135815.832790:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787135815.832843:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787135815.832904:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1787135815.832931:0:5815:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787135815.832956:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.832979:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98820e2800/0xf5850c552f2021e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2021e2 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.833008:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841489000/0xf5850c552f202213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20220c expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.833015:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841488400/0xf5850c552f20223d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202236 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.833023:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841488a00/0xf5850c552f202259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202252 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.833030:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98413cba00/0xf5850c552f202283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20227c expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.833036:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.833107:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98413cba00/0xf5850c552f202283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f20227c expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.833124:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e98413cba00/0xf5850c552f202283 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f20227c expref: 16 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.833142:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616360192:0@lo:104: 00000100:00100000:2.0:1787135815.833234:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787135815.833626:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841488a00/0xf5850c552f202259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f202252 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.833637:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9841488a00/0xf5850c552f202259 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f202252 expref: 16 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.833649:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616360320:0@lo:104: 00010000:00010000:2.0:1787135815.833693:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841488400/0xf5850c552f20223d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f202236 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.833702:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9841488400/0xf5850c552f20223d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f202236 expref: 16 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.833710:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616360448:0@lo:104: 00010000:00010000:2.0:1787135815.833735:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841489000/0xf5850c552f202213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f20220c expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.833744:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9841489000/0xf5850c552f202213 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f20220c expref: 16 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.833752:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616360576:0@lo:104: 00010000:00010000:2.0:1787135815.833801:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98820e2800/0xf5850c552f2021e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f2021e2 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.833810:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e98820e2800/0xf5850c552f2021e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f2021e2 expref: 16 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.833819:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616360704:0@lo:104: 00000100:00100000:2.0:1787135815.833840:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254900 going to sleep for 11 seconds 00000100:00100000:0.0:1787135815.834640:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787135815.834681:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135815.834727:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135815.834738:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135815.834750:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135815.834764:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616360192 00000100:00100000:0.0:1787135815.834773:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616360192 00000100:00100000:0.0:1787135815.834822:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616360320 00000100:00100000:0.0:1787135815.834825:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616360320 00000100:00100000:0.0:1787135815.834836:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616360448 00000100:00100000:0.0:1787135815.834839:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616360448 00000100:00100000:0.0:1787135815.834849:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616360576 00000100:00100000:0.0:1787135815.834852:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616360576 00000100:00100000:0.0:1787135815.834861:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616360704 00000100:00100000:0.0:1787135815.834864:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616360704 00000100:00100000:0.0:1787135815.834878:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787135815.834887:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852a97450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+7:5815:x1873947616360192:12345-0@lo:104: 00010000:00010000:0.0:1787135815.834905:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202283 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.834988:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787135815.834995:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852a97450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+7:5815:x1873947616360192:12345-0@lo:104: Request processed in 109us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135815.835002:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787135815.835086:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787135815.835092:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+6:5815:x1873947616360320:12345-0@lo:104: 00010000:00010000:0.0:1787135815.835101:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202259 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.835147:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787135815.835153:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+6:5815:x1873947616360320:12345-0@lo:104: Request processed in 62us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135815.835159:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787135815.835172:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787135815.835177:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+5:5815:x1873947616360448:12345-0@lo:104: 00010000:00010000:0.0:1787135815.835184:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20223d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.835994:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787135815.836008:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+5:5815:x1873947616360448:12345-0@lo:104: Request processed in 829us (1279us total) trans 0 rc 0/0 00010000:00010000:2.0:1787135815.836154:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787135815.836172:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202283 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836182:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cb400 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135815.836187:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202283 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836216:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202283 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135815.836225:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202283 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135815.836232:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135815.836302:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202283 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836309:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135815.836334:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202283 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836342:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98413cb400/0xf5850c552f20227c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202283 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836359:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787135815.836363:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202259 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836370:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841489600 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135815.836373:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202259 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836380:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202259 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135815.836387:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202259 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135815.836398:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135815.836412:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202259 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836419:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135815.836425:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202259 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836443:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f202252 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202259 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836454:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135815.836458:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20223d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836464:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840031a00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135815.836467:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f20223d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836474:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f20223d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135815.836481:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f20223d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135815.836487:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135815.836498:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20223d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836504:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135815.836527:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20223d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836534:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20223d expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836543:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135815.836545:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135815.836548:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135815.836581:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616360832:0@lo:103: 00000100:00100000:2.0:1787135815.836632:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.836681:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787135815.836687:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616360960:0@lo:103: 00000100:00100000:2.0:1787135815.836708:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.836733:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616361088:0@lo:103: 00000100:00100000:2.0:1787135815.836771:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.836819:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616360832 00000100:00100000:2.0:1787135815.836828:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616360832 00010000:00010000:2.0:1787135815.836858:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98413cba00/0xf5850c552f202283 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20227c expref: 17 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.836881:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616360960 00000100:00100000:2.0:1787135815.836883:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616360960 00010000:00010000:2.0:1787135815.836893:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841488a00/0xf5850c552f202259 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202252 expref: 18 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.836902:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616361088 00000100:00100000:2.0:1787135815.836904:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616361088 00010000:00010000:2.0:1787135815.836912:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841488400/0xf5850c552f20223d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202236 expref: 19 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.836936:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787135815.836943:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616360832:12345-0@lo:103: 00010000:00010000:2.0:1787135815.836957:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135815.836963:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98413cba00/0xf5850c552f202283 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20227c expref: 19 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836975:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98413cba00/0xf5850c552f202283 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f20227c expref: 19 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.836996:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135815.837303:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616360832:12345-0@lo:103: Request processed in 358us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135815.837311:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787135815.837331:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787135815.837338:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+18:3300:x1873947616360960:12345-0@lo:103: 00010000:00010000:2.0:1787135815.837346:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135815.837351:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841488a00/0xf5850c552f202259 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202252 expref: 18 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.837360:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841488a00/0xf5850c552f202259 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f202252 expref: 18 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.837371:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135815.837391:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+18:3300:x1873947616360960:12345-0@lo:103: Request processed in 55us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135815.837397:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787135815.837406:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787135815.837417:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874828e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+17:3302:x1873947616361088:12345-0@lo:103: 00010000:00010000:2.0:1787135815.837424:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135815.837428:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841488400/0xf5850c552f20223d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202236 expref: 17 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.837478:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841488400/0xf5850c552f20223d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f202236 expref: 17 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.837488:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135815.837514:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874828e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+17:3302:x1873947616361088:12345-0@lo:103: Request processed in 97us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135815.837520:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787135815.837547:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135815.837575:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616361088:0@lo:103: 00000100:00100000:2.0:1787135815.837599:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616360960:0@lo:103: 00000100:00100000:2.0:1787135815.837608:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616360832:0@lo:103: 00000100:00100000:0.0:1787135815.837670:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787135815.837695:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787135815.837703:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+4:5815:x1873947616360576:12345-0@lo:104: 00010000:00010000:0.0:1787135815.837716:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202213 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.837763:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787135815.837769:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd34e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+4:5815:x1873947616360576:12345-0@lo:104: Request processed in 68us (3030us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135815.837775:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787135815.837786:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787135815.837792:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+3:5815:x1873947616360704:12345-0@lo:104: 00010000:00010000:0.0:1787135815.837800:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2021e9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.837838:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787135815.837843:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+3:5815:x1873947616360704:12345-0@lo:104: Request processed in 51us (3092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135815.837849:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1787135815.837863:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787135815.837868:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202213 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.837876:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cb600 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:0.0:1787135815.837880:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202213 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.837889:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202213 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787135815.837896:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202213 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135815.837902:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787135815.837927:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202213 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.837934:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787135815.837946:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202213 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.837953:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f20220c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202213 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.837975:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787135815.837979:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2021e9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.837984:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840031e00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:0.0:1787135815.837987:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f2021e9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.837995:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f2021e9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787135815.838002:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f2021e9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135815.838007:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787135815.838018:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2021e9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.838495:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135815.838609:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98413cba00/0xf5850c552f202283 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f20227c expref: 16 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135815.838622:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d7b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616360192:0@lo:104: 00010000:00010000:3.0:1787135815.838633:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841488a00/0xf5850c552f202259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f202252 expref: 15 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135815.838642:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616360320:0@lo:104: 00010000:00010000:3.0:1787135815.838651:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841488400/0xf5850c552f20223d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f202236 expref: 14 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135815.838659:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616360448:0@lo:104: 00000100:00100000:3.0:1787135815.838667:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616360576:0@lo:104: 00000100:00100000:3.0:1787135815.838675:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5815:1873947616360704:0@lo:104: 00010000:00010000:3.0:1787135815.838705:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.838760:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787135815.838794:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616361344:0@lo:103: 00000100:00100000:3.0:1787135815.838840:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787135815.838891:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2021e9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.838899:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2021e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2021e9 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.838915:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135815.838916:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135815.838918:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135815.838929:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616361216:0@lo:103: 00000100:00100000:0.0:1787135815.838960:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135815.838994:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616361344 00000100:00100000:0.0:1787135815.839001:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616361344 00010000:00010000:0.0:1787135815.839037:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98820e2800/0xf5850c552f2021e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2021e2 expref: 14 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135815.839074:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616361216 00000100:00100000:0.0:1787135815.839077:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616361216 00010000:00010000:0.0:1787135815.839088:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841489000/0xf5850c552f202213 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20220c expref: 15 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135815.839100:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787135815.839106:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+15:3300:x1873947616361344:12345-0@lo:103: 00010000:00010000:0.0:1787135815.839120:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135815.839125:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98820e2800/0xf5850c552f2021e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2021e2 expref: 15 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.839136:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98820e2800/0xf5850c552f2021e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f2021e2 expref: 15 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.839152:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98820e2800/0xf5850c552f2021e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f2021e2 expref: 15 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.839165:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135815.839222:0:5808:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1787135815.839232:0:5808:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1787135815.839461:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787135815.839470:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+14:3303:x1873947616361216:12345-0@lo:103: 00010000:00010000:2.0:1787135815.839479:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135815.839484:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841489000/0xf5850c552f202213 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20220c expref: 14 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839495:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841489000/0xf5850c552f202213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f20220c expref: 14 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839517:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841489000/0xf5850c552f202213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f20220c expref: 14 pid: 5815 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839530:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839539:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839553:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839560:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839568:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839575:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839582:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7c00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787135815.839586:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839595:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839610:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839628:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135815.839665:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+13:3303:x1873947616361216:12345-0@lo:103: Request processed in 196us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135815.839674:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1787135815.839699:0:5815:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839706:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.839712:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e987c2c7c00/0xf5850c552f202298 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787135815.839728:0:5815:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787135815.840511:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+12:3300:x1873947616361344:12345-0@lo:103: Request processed in 1400us (1666us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135815.840522:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787135815.840603:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616361216:0@lo:103: 00000100:00100000:3.0:1787135815.845976:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616361344:0@lo:103: 00000100:00100000:3.0:1787135815.894887:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+11:7606:x1873947616360064:12345-0@lo:253: Request processed in 80023us (80361us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135815.894904:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787135815.895078:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616360064:0@lo:253: 10000000:01000000:2.0:1787135815.895095:0:7606:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787135815.895098:0:7606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787135815.895100:0:7606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787135815.895101:0:7606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787135815.895102:0:7606:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787135815.895104:0:7606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787135815.895105:0:7606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787135815.895106:0:7606:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787135815.895108:0:7606:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787135815.895109:0:7606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787135815.895111:0:7606:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787135815.895140:0:7606:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e9744a91800 from lustre-OST0001 10000000:01000000:2.0:1787135815.895165:0:7606:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787135815.895167:0:7606:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787135815.895176:0:7606:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e9860760000 local copy 10000000:01000000:2.0:1787135815.895180:0:7606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787135815.896828:0:7606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.896845:0:7606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.896857:0:7606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.896880:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616361472:0@lo:101: 00000100:00100000:2.0:1787135815.896948:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.897017:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98432540c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135815.897173:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616361472 00000100:00100000:1.0:1787135815.897181:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616361472 00000100:00100000:1.0:1787135815.897233:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787135815.897243:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+11:7606:x1873947616361472:12345-0@lo:101: 00010000:00010000:1.0:1787135815.897256:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135815.897271:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841489000/0xf5850c552f2022a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20229f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.897306:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841489000/0xf5850c552f2022a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20229f expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.897331:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841489000/0xf5850c552f2022a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20229f expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.897340:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841489000, rc 0) 00000100:00100000:1.0:1787135815.897387:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616361472:12345-0@lo:101: Request processed in 146us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.897394:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787135815.897518:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616361472:0@lo:101: 00010000:00010000:2.0:1787135815.897533:0:7606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf5850c552f2022a6 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.897542:0:7606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf5850c552f2022a6 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.897661:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616361600:0@lo:501: 00000100:00100000:2.0:1787135815.897686:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.897717:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98432540c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135815.897778:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616361600 00000100:00100000:3.0:1787135815.897783:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616361600 00000100:00100000:3.0:1787135815.897826:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787135815.897833:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616361600:12345-0@lo:501: 00000100:00100000:3.0:1787135815.898087:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616361600:12345-0@lo:501: Request processed in 254us (398us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787135815.898095:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787135815.898310:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616361600:0@lo:501: 10000000:01000000:2.0:1787135815.898324:0:7606:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787135815.898352:0:7606:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787135815.898358:0:7606:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf5850c552f2022a6 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.898366:0:7606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf5850c552f2022a6 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.898381:0:7606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf5850c552f2022a6 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.898411:0:7606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787135815.898436:0:7606:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e9744a91800 10000000:01000000:2.0:1787135815.898441:0:7606:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787135815.898446:0:7606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787135815.898449:0:7606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787135815.898453:0:7606:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787135815.898455:0:7606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787135815.898474:0:7606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.898482:0:7606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.898490:0:7606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.898503:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616361728:0@lo:101: 00000100:00100000:2.0:1787135815.898531:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.898562:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254c00 going to sleep for 11 seconds 00010000:00010000:0.0:1787135815.898619:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787135815.898633:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf5850c552f2022a6 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.898640:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7c00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:0.0:1787135815.898644:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf5850c552f2022a6 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.898652:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf5850c552f2022a6 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787135815.898659:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf5850c552f2022a6 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135815.898665:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787135815.898684:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf5850c552f2022a6 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.898691:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787135815.898719:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf5850c552f2022a6 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.898726:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7c00/0xf5850c552f20229f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf5850c552f2022a6 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.898739:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135815.898741:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135815.898742:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135815.898785:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616361728 00000100:00100000:1.0:1787135815.898789:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616361728 00000100:00100000:1.0:1787135815.898824:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787135815.898831:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616361728:12345-0@lo:101: 00010000:00010000:1.0:1787135815.898841:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135815.898852:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841488400/0xf5850c552f2022b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2022ad expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.898868:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841488400/0xf5850c552f2022b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2022ad expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.898878:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841488400/0xf5850c552f2022b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2022ad expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.898885:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841488400, rc 0) 00000100:00100000:1.0:1787135815.898914:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:7606:x1873947616361728:12345-0@lo:101: Request processed in 83us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.898920:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787135815.899150:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616361856:0@lo:103: 00000100:00100000:2.0:1787135815.899182:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.899237:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616361728:0@lo:101: 00010000:00010000:2.0:1787135815.899249:0:7606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2022b4 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.899267:0:7606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2022b4 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.899342:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616361984:0@lo:501: 00000100:00100000:2.0:1787135815.899368:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.899390:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787135815.899443:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616361856 00000100:00100000:0.0:1787135815.899447:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616361856 00000100:00100000:0.0:1787135815.899484:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787135815.899491:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874828a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+13:3301:x1873947616361856:12345-0@lo:103: 00010000:00010000:0.0:1787135815.899508:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135815.899520:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841489000/0xf5850c552f2022a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f20229f expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.899530:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135815.899562:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874828a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+12:3301:x1873947616361856:12345-0@lo:103: Request processed in 72us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135815.899569:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787135815.899593:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616361856:0@lo:103: 00000100:00100000:1.0:1787135815.899644:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616361984 00000100:00100000:1.0:1787135815.899648:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616361984 00000100:00100000:1.0:1787135815.899679:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787135815.899693:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616361984:12345-0@lo:501: 00000100:00100000:1.0:1787135815.899894:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616361984:12345-0@lo:501: Request processed in 202us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.899901:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787135815.900130:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616361984:0@lo:501: 00000100:00100000:2.0:1787135815.900159:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362112:0@lo:503: 00000100:00100000:2.0:1787135815.900197:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.900255:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787135815.901420:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616362112 00000100:00100000:0.0:1787135815.901430:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616362112 00000100:00100000:0.0:1787135815.901543:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787135815.901552:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616362112:12345-0@lo:503: 00000100:00100000:0.0:1787135815.901770:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616362112:12345-0@lo:503: Request processed in 219us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135815.901779:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787135815.901877:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362112:0@lo:503: 00000040:00080000:2.0:1787135815.902183:0:7606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787135815.902261:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362240:0@lo:502: 00000100:00100000:2.0:1787135815.902318:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135815.902858:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616362240 00000100:00100000:1.0:1787135815.902864:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616362240 00000100:00100000:1.0:1787135815.902894:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787135815.902901:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616362240:12345-0@lo:502: 00000100:00100000:1.0:1787135815.903082:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616362240:12345-0@lo:502: Request processed in 181us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.903089:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787135815.903356:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787135815.903378:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362240:0@lo:502: 00000040:00080000:2.0:1787135815.903730:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787135815.903854:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787135815.903900:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787135815.903951:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787135815.903998:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787135815.904033:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787135815.904097:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362368:0@lo:502: 00000100:00100000:2.0:1787135815.904149:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.904182:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787135815.904357:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616362368 00000100:00100000:1.0:1787135815.904364:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616362368 00000100:00100000:1.0:1787135815.904406:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787135815.904413:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616362368:12345-0@lo:502: 00000100:00100000:1.0:1787135815.904698:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616362368:12345-0@lo:502: Request processed in 285us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.904706:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787135815.904795:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362368:0@lo:502: 00000040:00080000:2.0:1787135815.904897:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787135815.904907:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787135815.905873:0:7615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787135815.905882:0:7615:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787135815.905888:0:7615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787135815.905890:0:7615:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787135815.905896:0:7615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787135815.905920:0:7615:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e9874180000) 00000020:00000080:1.0:1787135815.905944:0:7615:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787135815.905951:0:7615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787135815.906173:0:7615:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e9744a91800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787135815.906180:0:7615:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787135815.906192:0:7615:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf5850c552f2022c2 00010000:00010000:1.0:1787135815.914605:0:7615:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787135815.916519:0:7615:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1787135815.919968:0:7615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787135815.920780:0:7615:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1787135815.926602:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1787135815.927428:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787135815.929509:0:7615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1787135815.929521:0:7615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787135815.929527:0:7615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787135815.929529:0:7615:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1787135815.929533:0:7615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787135815.929537:0:7615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787135815.929538:0:7615:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787135815.929541:0:7615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787135815.929543:0:7615:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787135815.929591:0:7615:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787135815.929595:0:7615:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787135815.929596:0:7615:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787135815.929599:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787135815.929743:0:7606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787135815.929770:0:7606:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787135815.929787:0:7606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2022b4 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.929801:0:7606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2022b4 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135815.929810:0:7606:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e9744a91800 from 1 10000000:01000000:2.0:1787135815.929813:0:7606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787135815.929848:0:7606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.929857:0:7606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.929867:0:7606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.929890:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362496:0@lo:101: 00000100:00100000:2.0:1787135815.929960:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.930016:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254480 going to sleep for 11 seconds 00000100:00100000:1.0:1787135815.931128:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616362496 00000100:00100000:1.0:1787135815.931140:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616362496 00000100:00100000:1.0:1787135815.931182:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787135815.931193:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+12:7606:x1873947616362496:12345-0@lo:101: 00010000:00010000:1.0:1787135815.931209:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135815.931224:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841488a00/0xf5850c552f2022d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2022c9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.931250:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841488a00/0xf5850c552f2022d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2022c9 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.931261:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841488a00/0xf5850c552f2022d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2022c9 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.931278:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841488a00, rc 0) 00000100:00100000:1.0:1787135815.931352:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+13:7606:x1873947616362496:12345-0@lo:101: Request processed in 161us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.931359:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787135815.931502:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362496:0@lo:101: 00010000:00010000:2.0:1787135815.931519:0:7606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2022d0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.931529:0:7606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2022d0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.931635:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362624:0@lo:501: 00000100:00100000:2.0:1787135815.931665:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.931701:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254480 going to sleep for 11 seconds 00000100:00100000:0.0:1787135815.931752:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616362624 00000100:00100000:0.0:1787135815.931757:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616362624 00000100:00100000:0.0:1787135815.931788:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787135815.931795:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:7606:x1873947616362624:12345-0@lo:501: 00000100:00100000:0.0:1787135815.933139:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:7606:x1873947616362624:12345-0@lo:501: Request processed in 1337us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135815.933151:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787135815.933350:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362624:0@lo:501: 00000100:00100000:2.0:1787135815.933394:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362752:0@lo:503: 00000100:00100000:2.0:1787135815.933440:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.933626:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254480 going to sleep for 11 seconds 00000100:00100000:1.0:1787135815.938703:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616362752 00000100:00100000:1.0:1787135815.938718:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616362752 00000100:00100000:1.0:1787135815.938778:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787135815.938789:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:7606:x1873947616362752:12345-0@lo:503: 00000100:00100000:1.0:1787135815.939387:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:7606:x1873947616362752:12345-0@lo:503: Request processed in 597us (5944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.939398:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787135815.939518:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362752:0@lo:503: 00000040:00080000:3.0:1787135815.939818:0:7606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787135815.939891:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362880:0@lo:502: 00000100:00100000:3.0:1787135815.939943:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135815.939992:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135815.940405:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616362880 00000100:00100000:1.0:1787135815.940412:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616362880 00000100:00100000:1.0:1787135815.940497:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787135815.940506:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+13:7606:x1873947616362880:12345-0@lo:502: 00000100:00100000:1.0:1787135815.940689:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+13:7606:x1873947616362880:12345-0@lo:502: Request processed in 184us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.940696:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787135815.940782:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616362880:0@lo:502: 00000040:00080000:3.0:1787135815.941085:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787135815.941136:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787135815.941164:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616363008:0@lo:502: 00000100:00100000:3.0:1787135815.941202:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135815.945676:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616363008 00000100:00100000:0.0:1787135815.945691:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616363008 00000100:00100000:3.0:1787135815.945800:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135815.945925:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787135815.945937:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:7606:x1873947616363008:12345-0@lo:502: 00000100:00100000:2.0:1787135815.946237:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:7606:x1873947616363008:12345-0@lo:502: Request processed in 302us (5033us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135815.946246:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787135815.946350:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd54a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616363008:0@lo:502: 00000040:00080000:3.0:1787135815.946522:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787135815.946537:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787135815.947262:0:7619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787135815.947273:0:7619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787135815.947275:0:7619:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787135815.947282:0:7619:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e9744a91800 00000020:00000080:3.0:1787135815.947284:0:7619:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787135815.947315:0:7619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787135815.947318:0:7619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787135815.947320:0:7619:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787135815.947330:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787135815.947501:0:7606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787135815.947522:0:7606:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787135815.947550:0:7606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2022d0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.947562:0:7606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2022d0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135815.947605:0:7606:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787135815.947609:0:7606:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e9744a91800 10000000:01000000:0.0:1787135815.947612:0:7606:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e9744a91800 10000000:01000000:0.0:1787135815.947616:0:7606:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787135815.947622:0:7606:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e9744a91800 from 1 10000000:01000000:0.0:1787135815.947624:0:7606:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787135815.947656:0:7606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.947664:0:7606:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135815.947674:0:7606:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135815.947694:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616363136:0@lo:101: 00000100:00100000:0.0:1787135815.947746:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135815.948351:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616363136 00000100:00100000:1.0:1787135815.948359:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616363136 00000100:00100000:1.0:1787135815.948397:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787135815.948405:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:7606:x1873947616363136:12345-0@lo:101: 00010000:00010000:1.0:1787135815.948429:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135815.948444:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841489600/0xf5850c552f2022de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2022d7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.948482:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841489600/0xf5850c552f2022de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2022d7 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.948501:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841489600/0xf5850c552f2022de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2022d7 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.948510:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841489600, rc 0) 00000100:00100000:1.0:1787135815.948552:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:7606:x1873947616363136:12345-0@lo:101: Request processed in 148us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.948560:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787135815.949112:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9860782cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135815.949141:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616363136:0@lo:101: 00010000:00010000:2.0:1787135815.949159:0:7606:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2022de expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135815.949169:0:7606:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2022de expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135815.949267:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874829880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616363264:0@lo:501: 00000100:00100000:2.0:1787135815.949316:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.949343:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787135815.949403:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616363264 00000100:00100000:0.0:1787135815.949408:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616363264 00000100:00100000:0.0:1787135815.949839:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787135815.949848:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:7606:x1873947616363264:12345-0@lo:501: 00000100:00100000:0.0:1787135815.950252:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:7606:x1873947616363264:12345-0@lo:501: Request processed in 405us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135815.950260:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787135815.950359:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874829880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616363264:0@lo:501: 00000100:00100000:2.0:1787135815.950401:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874829880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616363392:0@lo:503: 00000100:00100000:2.0:1787135815.950440:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.950471:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787135815.950567:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616363392 00000100:00100000:0.0:1787135815.950572:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616363392 00000100:00100000:0.0:1787135815.950603:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787135815.950610:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+14:7606:x1873947616363392:12345-0@lo:503: 00000100:00100000:0.0:1787135815.950746:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+14:7606:x1873947616363392:12345-0@lo:503: Request processed in 136us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135815.950752:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787135815.950823:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874829880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616363392:0@lo:503: 00000040:00080000:2.0:1787135815.951765:0:7606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787135815.951831:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874829880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616363520:0@lo:502: 00000100:00100000:2.0:1787135815.951884:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.951911:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787135815.951975:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616363520 00000100:00100000:3.0:1787135815.952064:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616363520 00000100:00100000:3.0:1787135815.952105:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787135815.952114:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:7606:x1873947616363520:12345-0@lo:502: 00000100:00100000:3.0:1787135815.952324:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:7606:x1873947616363520:12345-0@lo:502: Request processed in 211us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135815.952332:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787135815.952435:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874829880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616363520:0@lo:502: 00000040:00080000:2.0:1787135815.952775:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787135815.952825:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787135815.952861:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787135815.952921:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787135815.952963:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787135815.953606:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787135815.953652:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787135815.953689:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787135815.953740:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787135815.953776:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787135815.953809:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787135815.953858:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787135815.953894:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787135815.953929:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787135815.953978:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787135815.954657:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787135815.954714:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787135815.954770:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787135815.954808:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787135815.954841:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787135815.954915:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787135815.954956:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787135815.955191:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787135815.955244:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787135815.955280:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787135815.955327:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787135815.955378:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787135815.955414:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787135815.955448:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787135815.955501:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787135815.955538:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787135815.955574:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787135815.955632:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787135815.955697:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787135815.955737:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787135815.955786:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787135815.955823:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787135815.957426:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874829880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616363648:0@lo:502: 00000100:00100000:2.0:1787135815.957572:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.957662:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787135815.957712:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616363648 00000100:00100000:3.0:1787135815.957720:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616363648 00000100:00100000:3.0:1787135815.957801:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787135815.957811:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:7606:x1873947616363648:12345-0@lo:502: 00000100:00100000:3.0:1787135815.958098:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:7606:x1873947616363648:12345-0@lo:502: Request processed in 288us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135815.958106:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787135815.958198:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874829880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616363648:0@lo:502: 00000040:00080000:0.0:1787135815.958311:0:7606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787135815.958325:0:7606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787135815.958994:0:7620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787135815.959010:0:7620:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e987c3f99c0) 00000020:00000080:0.0:1787135815.959031:0:7620:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787135815.959217:0:7620:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e9744a91800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787135815.959221:0:7620:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e9744a91800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787135815.959224:0:7620:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e9744a91800 3 00010000:00080000:0.0:1787135815.959269:0:7620:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8e9746924000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1787135815.960881:0:7620:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787135815.960984:0:7620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787135815.961019:0:7620:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787135815.961032:0:7620:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf5850c552f2022ec 00000100:00080000:0.0:1787135815.961041:0:7620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787135815.961074:0:7620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e9746924000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1787135815.961109:0:7620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e987bd35180 x1873947616363776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787135815.961154:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1873947616363776:0@lo:38: 00000100:00100000:0.0:1787135815.961218:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787135815.961302:0:7620:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787135815.961378:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616363904:0@lo:400: 00000100:00100000:0.0:1787135815.961405:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135815.961425:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787135815.961431:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616364032:0@lo:400: 00000100:00100000:0.0:1787135815.961453:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135815.961481:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616364160:0@lo:400: 00000100:00100000:0.0:1787135815.961506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135815.961702:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616364160 00000100:00100000:1.0:1787135815.961709:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616364160 00000100:00100000:1.0:1787135815.961762:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787135815.961775:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616364160:12345-0@lo:400: 00000100:00100000:1.0:1787135815.961834:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616364160:12345-0@lo:400: Request processed in 63us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.961841:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787135815.961880:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd35500 x1873947616364160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135815.961893:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616364160:0@lo:400: 00000100:00100000:1.0:1787135815.965109:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616363776 00000100:00100000:1.0:1787135815.965125:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616363776 00000100:00100000:1.0:1787135815.965159:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616363904 00000100:00100000:1.0:1787135815.965163:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616363904 00000100:00100000:1.0:1787135815.965192:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616364032 00000100:00100000:1.0:1787135815.965195:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616364032 00000100:00100000:1.0:1787135815.965221:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787135815.965244:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616363904:12345-0@lo:400: 00000100:00100000:1.0:1787135815.965363:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616363904:12345-0@lo:400: Request processed in 121us (3956us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.965370:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787135815.965388:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787135815.965395:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616364032:12345-0@lo:400: 00000100:00100000:2.0:1787135815.965576:0:5822:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787135815.965587:0:5822:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000040:00080000:2.0:1787135815.965902:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1787135815.966083:0:7621:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8e9874828380 x1873947616364288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135815.966095:0:7621:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254900 going to sleep for 0 seconds 00000100:00100000:1.0:1787135815.966227:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616364032:12345-0@lo:400: Request processed in 832us (4772us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.966235:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787135815.966251:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787135815.966256:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1873947616363776:12345-0@lo:38: 00010000:00080000:1.0:1787135815.966275:0:5821:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:1.0:1787135815.966319:0:5821:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf5850c552f2022f3 00000004:00100000:1.0:1787135815.966334:0:5821:0:(mdt_handler.c:7490:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787135815.966365:0:5821:0:(import.c:65:import_set_state_nolock()) ffff8e98746a1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787135815.966708:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873947616363776:12345-0@lo:38: Request processed in 449us (5488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.966716:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787135815.966763:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd37800 x1873947616364032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135815.966777:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616364032:0@lo:400: 00010000:00080000:1.0:1787135815.966790:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd36a00 x1873947616363904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135815.966798:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616363904:0@lo:400: 00000020:01000000:1.0:1787135815.966825:0:7606:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787135815.966863:0:7606:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00080000:2.0:1787135815.966902:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e987bd35180 x1873947616363776/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787135825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135815.966911:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787135815.966918:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1787135815.966927:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787135815.966937:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787135815.966940:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e9746924000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1787135815.966947:0:3299:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002979335c): req@ffff8e9874828380 x1873947616364288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135815.966963:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1873947616363776:0@lo:38: 00000100:00100000:2.0:1787135815.967113:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135815.967141:0:7621:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843254900 going to sleep for 11 seconds 00010000:00010000:1.0:1787135815.967264:0:7606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2022de expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135815.967276:0:7606:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2022de expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135815.967329:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616364288 00000100:00100000:1.0:1787135815.967335:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616364288 00000100:00100000:1.0:1787135815.967380:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787135815.967388:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987482ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7621:x1873947616364288:12345-0@lo:901: 00000100:00100000:1.0:1787135815.967752:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987482ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7621:x1873947616364288:12345-0@lo:901: Request processed in 364us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135815.967760:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000004:1.0:1787135815.967800:0:7606:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787135815.967802:0:7606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787135815.967804:0:7606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787135815.967805:0:7606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787135815.967806:0:7606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787135815.967808:0:7606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787135815.967810:0:7606:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787135815.967811:0:7606:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787135815.967812:0:7606:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787135815.967814:0:7606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787135815.967815:0:7606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787135815.967819:0:7606:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787135815.967821:0:7606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787135815.967823:0:7606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787135815.967824:0:7606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787135815.967826:0:7606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787135815.967827:0:7606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787135815.967828:0:7606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787135815.967829:0:7606:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787135815.967830:0:7606:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787135815.967831:0:7606:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787135815.967848:0:7606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787135815.967849:0:7606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787135815.967868:0:7606:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787135815.967881:0:7606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874979c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616364416:0@lo:253: 00000100:00100000:1.0:1787135815.967921:0:7606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135815.967950:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616364416 00000100:00100000:1.0:1787135815.967954:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616364416 00000100:00100000:1.0:1787135815.967980:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787135815.968001:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+14:7606:x1873947616364416:12345-0@lo:253: 20000000:01000000:1.0:1787135815.968032:0:5816:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787135815.968077:0:5816:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787135815.969458:0:7606:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f5cc0 going to sleep for 11 seconds 00000100:00080000:0.0:1787135815.969537:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787135815.969544:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787135815.972674:0:7621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9874828380 x1873947616364288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787135831 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135815.972694:0:7621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874828380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7621:1873947616364288:0@lo:901: 20000000:01000000:1.0:1787135816.004839:0:5816:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787135816.004854:0:5816:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787135816.006661:0:5837:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787135816.006670:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787135816.006741:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135816.006765:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9840031400/0xf5850c552f20224b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202244 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135816.006773:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135816.006815:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9840031400/0xf5850c552f20224b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f202244 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135816.006830:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9840031400/0xf5850c552f20224b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f202244 expref: 14 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135816.006858:0:5837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd54a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1873947616364544:0@lo:104: 00000100:00100000:3.0:1787135816.006924:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135816.007068:0:5837:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135816.007259:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616364544 00000100:00100000:2.0:1787135816.007267:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616364544 00000100:00100000:2.0:1787135816.007323:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787135816.007333:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:5837:x1873947616364544:12345-0@lo:104: 00010000:00010000:2.0:1787135816.007347:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20224b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007431:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135816.007449:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:5837:x1873947616364544:12345-0@lo:104: Request processed in 118us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135816.007456:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787135816.007518:0:5837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd54a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5837:1873947616364544:0@lo:104: 00010000:00010000:2.0:1787135816.007551:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007568:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135816.007573:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20224b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007601:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841489e00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135816.007604:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f20224b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007611:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f20224b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135816.007637:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f20224b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135816.007642:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135816.007684:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20224b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007691:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135816.007709:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20224b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007716:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202244 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20224b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007733:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135816.007735:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135816.007738:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135816.007755:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616364672:0@lo:103: 00000100:00100000:2.0:1787135816.007788:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135816.007829:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616364672 00000100:00100000:2.0:1787135816.007833:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616364672 00010000:00010000:2.0:1787135816.007852:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9840031400/0xf5850c552f20224b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202244 expref: 15 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135816.007883:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787135816.007889:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+15:3301:x1873947616364672:12345-0@lo:103: 00010000:00010000:2.0:1787135816.007900:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135816.007904:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9840031400/0xf5850c552f20224b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202244 expref: 15 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007915:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9840031400/0xf5850c552f20224b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f202244 expref: 15 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007928:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9840031400/0xf5850c552f20224b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f202244 expref: 15 pid: 5813 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007941:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007949:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787135816.007962:0:5807:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001292868s 00010000:00010000:2.0:1787135816.007966:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007974:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007993:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.007999:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.008011:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787135816.008015:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.008022:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.008035:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.008043:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135816.008108:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432c1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+14:3301:x1873947616364672:12345-0@lo:103: Request processed in 219us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135816.008115:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1787135816.008158:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.008166:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135816.008172:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98820e2400/0xf5850c552f2022fa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135816.008199:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874828380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616364672:0@lo:103: 00000100:00100000:1.0:1787135816.015523:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:7606:x1873947616364416:12345-0@lo:253: Request processed in 47514us (47592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135816.015537:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787135816.015659:0:7606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874979c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e67bffa2-3749-4eab-9303-62ad12948de4:7606:1873947616364416:0@lo:253: 10000000:01000000:2.0:1787135816.015674:0:7606:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787135816.015677:0:7606:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787135816.015678:0:7606:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787135816.015693:0:7606:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787135816.015694:0:7606:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787135816.015695:0:7606:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787135816.015697:0:7606:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787135816.015698:0:7606:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787135816.015700:0:7606:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787135816.015701:0:7606:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787135816.015703:0:7606:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787135816.015704:0:7606:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787135816.015719:0:7606:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787135816.026385:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787135816.026880:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787135816.029196:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787135816.029396:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787135816.029763:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787135816.030261:0:7606:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787135816.033497:0:7606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1787135816.319219:0:7606:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1787135816.319228:0:7606:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1787135816.319266:0:7606:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787135816.319330:0:7606:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787135816.319347:0:7606:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1787135816.319372:0:7606:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787135816.793211:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135817.816336:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135818.841406:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135819.224261:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787135819.225451:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616364800:0@lo:13: 00000100:00100000:2.0:1787135819.225521:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135819.226126:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616364800 00000100:00100000:1.0:1787135819.226135:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616364800 00000100:00100000:1.0:1787135819.226195:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787135819.226205:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616364800:12345-0@lo:13: 00002000:00000024:1.0:1787135819.226239:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135819.226305:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874828380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616364800:12345-0@lo:13: Request processed in 102us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135819.226313:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787135819.226412:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787135819.226478:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd36680 x1873947616364800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135819.226498:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616364800:0@lo:13: 00010000:00010000:2.0:1787135819.864381:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135820.891202:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135821.276622:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616364928:0@lo:400: 00000100:00100000:3.0:1787135821.276653:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616365312:0@lo:400: 00000100:00100000:2.0:1787135821.276702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135821.279289:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616365056:0@lo:400: 00000100:00100000:3.0:1787135821.279896:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135821.279996:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616364928 00000100:00100000:3.0:1787135821.280004:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616364928 00000100:00100000:3.0:1787135821.280147:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787135821.280150:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616365440:0@lo:400: 00000100:00100000:3.0:1787135821.280159:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+13:3303:x1873947616364928:12345-0@lo:400: 00000100:00100000:2.0:1787135821.280204:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135821.280220:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+13:3303:x1873947616364928:12345-0@lo:400: Request processed in 63us (3518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135821.280230:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787135821.280361:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616364928:0@lo:400: 00000100:00100000:2.0:1787135821.280405:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616365184:0@lo:400: 00000100:00100000:0.0:1787135821.280458:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616365312 00000100:00100000:0.0:1787135821.280463:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616365312 00000100:00100000:0.0:1787135821.280502:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787135821.280509:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616365312:12345-0@lo:400: 00000100:00100000:0.0:1787135821.280553:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616365312:12345-0@lo:400: Request processed in 44us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135821.280638:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787135821.280695:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787135821.280719:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd36a00 x1873947616365312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135821.280731:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616365312:0@lo:400: 00000100:00100000:2.0:1787135821.280774:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135821.280816:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135821.280895:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616365440 00000100:00100000:2.0:1787135821.280901:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616365440 00000100:00100000:0.0:1787135821.284450:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616365184 00000100:00100000:0.0:1787135821.284464:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616365184 00000100:00100000:0.0:1787135821.284529:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616365056 00000100:00100000:0.0:1787135821.284532:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616365056 00000100:00100000:0.0:1787135821.284551:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787135821.284648:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616365440:12345-0@lo:400: 00000100:00080000:2.0:1787135821.284718:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135821.284741:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616365440:12345-0@lo:400: Request processed in 181us (4536us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135821.284749:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1787135821.284762:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd37800 x1873947616365440/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135821.284770:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787135821.284780:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616365184:12345-0@lo:400: 00000100:00100000:2.0:1787135821.284803:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616365440:0@lo:400: 00000100:00100000:0.0:1787135821.284820:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616365184:12345-0@lo:400: Request processed in 40us (4045us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135821.284826:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787135821.284841:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787135821.284849:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616365056:12345-0@lo:400: 00010000:00080000:2.0:1787135821.284853:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd35180 x1873947616365184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135821.284865:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616365184:0@lo:400: 00000100:00100000:0.0:1787135821.284888:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616365056:12345-0@lo:400: Request processed in 39us (4072us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135821.284894:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1787135821.284928:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd37100 x1873947616365056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135821.284939:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616365056:0@lo:400: 00010000:00010000:2.0:1787135821.916086:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787135822.507923:0:7964:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787135822.951075:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787135823.833250:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787135823.833258:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e98735aa000 from 30 10000000:01000000:2.0:1787135823.833263:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787135823.833306:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135823.833317:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135823.833327:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135823.833350:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616365568:0@lo:101: 00000100:00100000:2.0:1787135823.833423:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135823.833541:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616365568 00000100:00100000:2.0:1787135823.833546:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135823.833549:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616365568 00000100:00100000:3.0:1787135823.833614:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787135823.833623:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616365568:12345-0@lo:101: 00010000:00010000:3.0:1787135823.833634:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135823.833647:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98820e3400/0xf5850c552f202308 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202301 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.833671:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98820e3400/0xf5850c552f202308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202301 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.833696:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98820e3400/0xf5850c552f202308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202301 expref: 14 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.833704:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e3400, rc 0) 00000100:00100000:3.0:1787135823.833746:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616365568:12345-0@lo:101: Request processed in 125us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135823.833752:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787135823.834314:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616365568:0@lo:101: 00010000:00010000:0.0:1787135823.834329:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202308 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.834508:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202308 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135823.834575:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616365696:0@lo:501: 00000100:00100000:0.0:1787135823.834610:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135823.834643:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2480 going to sleep for 11 seconds 00000100:00100000:2.0:1787135823.834673:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616365696 00000100:00100000:2.0:1787135823.834678:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616365696 00000100:00100000:2.0:1787135823.834717:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787135823.834725:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616365696:12345-0@lo:501: 00000100:00100000:2.0:1787135823.835042:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616365696:12345-0@lo:501: Request processed in 317us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135823.835076:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616365696:0@lo:501: 00000100:00100000:2.0:1787135823.835082:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1787135823.835115:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616365824:0@lo:503: 00000100:00100000:3.0:1787135823.835158:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135823.835179:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f80cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135823.835251:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616365824 00000100:00100000:2.0:1787135823.835256:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616365824 00000100:00100000:2.0:1787135823.836303:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787135823.836320:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616365824:12345-0@lo:503: 00000100:00100000:2.0:1787135823.836655:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616365824:12345-0@lo:503: Request processed in 341us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135823.836664:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787135823.836743:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616365824:0@lo:503: 00000100:00100000:2.0:1787135823.837506:0:8036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8036:1873947616365952:0@lo:502: 00000100:00100000:2.0:1787135823.837558:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135823.837633:0:8036:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98744869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135823.837767:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616365952 00000100:00100000:3.0:1787135823.837774:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616365952 00000100:00100000:3.0:1787135823.837847:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787135823.837856:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:8036:x1873947616365952:12345-0@lo:502: 00000100:00100000:3.0:1787135823.838145:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:8036:x1873947616365952:12345-0@lo:502: Request processed in 289us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135823.838152:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787135823.838457:0:8036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8036:1873947616365952:0@lo:502: 00000100:00100000:2.0:1787135823.838511:0:8036:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8036:1873947616366080:0@lo:502: 00000100:00100000:2.0:1787135823.838548:0:8036:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135823.838758:0:8036:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98744869c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135823.838864:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616366080 00000100:00100000:3.0:1787135823.838869:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616366080 00000100:00100000:3.0:1787135823.838907:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787135823.838915:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:8036:x1873947616366080:12345-0@lo:502: 00000100:00100000:3.0:1787135823.839105:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:8036:x1873947616366080:12345-0@lo:502: Request processed in 190us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135823.839111:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787135823.839208:0:8036:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8036:1873947616366080:0@lo:502: 00000040:00080000:2.0:1787135823.839229:0:8036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787135823.839398:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787135823.839418:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787135823.839483:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202308 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.839495:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202308 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787135823.839505:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787135823.839507:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787135823.839510:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787135823.839535:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.839543:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.839552:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135823.839566:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616366208:0@lo:101: 00000100:00100000:3.0:1787135823.839597:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135823.839774:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787135823.839825:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616366208 00000100:00100000:2.0:1787135823.839830:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616366208 00000100:00100000:2.0:1787135823.839863:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787135823.839870:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616366208:12345-0@lo:101: 00010000:00010000:2.0:1787135823.839879:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135823.839891:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e987c2c7e00/0xf5850c552f202316 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20230f expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135823.839924:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e987c2c7e00/0xf5850c552f202316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20230f expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135823.839933:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e987c2c7e00/0xf5850c552f202316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20230f expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135823.839942:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7e00, rc 0) 00000100:00100000:2.0:1787135823.839972:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616366208:12345-0@lo:101: Request processed in 103us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135823.839978:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787135823.840084:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616366208:0@lo:101: 00010000:00010000:3.0:1787135823.840098:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202316 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.840107:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202316 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135823.840162:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616366336:0@lo:501: 00000100:00100000:3.0:1787135823.840185:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135823.840196:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f80b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787135823.840264:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616366336 00000100:00100000:0.0:1787135823.840269:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616366336 00000100:00100000:0.0:1787135823.840297:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787135823.840305:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616366336:12345-0@lo:501: 00000100:00100000:0.0:1787135823.840810:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616366336:12345-0@lo:501: Request processed in 505us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135823.840818:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787135823.840900:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616366336:0@lo:501: 00000100:00100000:3.0:1787135823.840933:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616366464:0@lo:503: 00000100:00100000:3.0:1787135823.840974:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135823.841760:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787135823.841903:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616366464 00000100:00100000:2.0:1787135823.841910:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616366464 00000100:00100000:2.0:1787135823.841950:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1787135823.841958:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616366464:12345-0@lo:503: 00000100:00100000:2.0:1787135823.842298:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616366464:12345-0@lo:503: Request processed in 339us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135823.842305:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787135823.842334:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616366464:0@lo:503: 00000100:00100000:2.0:1787135823.843553:0:8037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8037:1873947616366592:0@lo:502: 00000100:00100000:2.0:1787135823.843752:0:8037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135823.843837:0:8037:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787135823.843875:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616366592 00000100:00100000:0.0:1787135823.843882:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616366592 00000100:00100000:0.0:1787135823.843925:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787135823.843934:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+15:8037:x1873947616366592:12345-0@lo:502: 00000100:00100000:0.0:1787135823.844354:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+15:8037:x1873947616366592:12345-0@lo:502: Request processed in 420us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135823.844378:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787135823.844542:0:8037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8037:1873947616366592:0@lo:502: 00000020:01000000:2.0:1787135823.844571:0:8037:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787135823.844580:0:8037:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787135823.844583:0:8037:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787135823.844588:0:8037:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787135823.844589:0:8037:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787135823.844746:0:8037:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8037:1873947616366720:0@lo:502: 00000100:00100000:2.0:1787135823.844788:0:8037:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135823.844846:0:8037:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787135823.844878:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616366720 00000100:00100000:3.0:1787135823.844884:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616366720 00000100:00100000:3.0:1787135823.844946:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787135823.844954:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:8037:x1873947616366720:12345-0@lo:502: 00000100:00100000:3.0:1787135823.845157:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:8037:x1873947616366720:12345-0@lo:502: Request processed in 204us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135823.845165:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787135823.845263:0:8037:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8037:1873947616366720:0@lo:502: 00000020:01000000:0.0:1787135823.845282:0:8037:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787135823.845287:0:8037:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135823.845289:0:8037:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787135823.845296:0:8037:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1787135823.845785:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1787135823.845805:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787135823.845816:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202316 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135823.845828:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202316 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787135823.845839:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787135823.845841:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e98456a5800 from 30 10000000:01000000:1.0:1787135823.845845:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787135823.845885:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135823.845893:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135823.845902:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135823.845919:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616366848:0@lo:101: 00000100:00100000:1.0:1787135823.846242:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135823.846280:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98533a6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787135823.846295:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616366848 00000100:00100000:3.0:1787135823.846303:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616366848 00000100:00100000:3.0:1787135823.846345:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787135823.846354:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616366848:12345-0@lo:101: 00010000:00010000:3.0:1787135823.846365:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135823.846380:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98820e2200/0xf5850c552f202324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20231d expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.846402:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98820e2200/0xf5850c552f202324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20231d expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.846436:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98820e2200/0xf5850c552f202324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20231d expref: 16 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.846444:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e2200, rc 0) 00000100:00100000:3.0:1787135823.846485:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616366848:12345-0@lo:101: Request processed in 132us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135823.846492:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787135823.847038:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616366848:0@lo:101: 00010000:00010000:1.0:1787135823.847104:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202324 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135823.847116:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202324 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135823.847186:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616366976:0@lo:501: 00000100:00100000:1.0:1787135823.847282:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135823.847355:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98533a6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787135823.850346:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616366976 00000100:00100000:3.0:1787135823.850360:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616366976 00000100:00100000:2.0:1787135823.851002:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787135823.851016:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616366976:12345-0@lo:501: 00000100:00100000:2.0:1787135823.851367:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616366976:12345-0@lo:501: Request processed in 354us (4084us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135823.851376:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787135823.851473:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616366976:0@lo:501: 00000100:00100000:1.0:1787135823.851527:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616367104:0@lo:503: 00000100:00100000:1.0:1787135823.851575:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135823.851613:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98533a6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787135823.851783:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616367104 00000100:00100000:2.0:1787135823.851789:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616367104 00000100:00100000:2.0:1787135823.851822:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787135823.851829:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616367104:12345-0@lo:503: 00000100:00100000:2.0:1787135823.852272:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616367104:12345-0@lo:503: Request processed in 441us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135823.852280:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787135823.852362:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616367104:0@lo:503: 00000100:00100000:2.0:1787135823.852897:0:8038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874828700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8038:1873947616367232:0@lo:502: 00000100:00100000:2.0:1787135823.853215:0:8038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135823.853258:0:8038:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787135823.853303:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616367232 00000100:00100000:0.0:1787135823.853316:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616367232 00000100:00100000:0.0:1787135823.853361:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787135823.853370:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+16:8038:x1873947616367232:12345-0@lo:502: 00000100:00100000:0.0:1787135823.853567:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+16:8038:x1873947616367232:12345-0@lo:502: Request processed in 199us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135823.853574:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787135823.855177:0:8038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874828700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8038:1873947616367232:0@lo:502: 00000100:00100000:2.0:1787135823.855257:0:8038:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874828700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8038:1873947616367360:0@lo:502: 00000100:00100000:2.0:1787135823.855308:0:8038:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135823.855400:0:8038:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787135823.857995:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616367360 00000100:00100000:3.0:1787135823.858010:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616367360 00000100:00100000:3.0:1787135823.858202:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787135823.858213:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:8038:x1873947616367360:12345-0@lo:502: 00000100:00100000:3.0:1787135823.858505:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:8038:x1873947616367360:12345-0@lo:502: Request processed in 294us (3195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135823.858513:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787135823.862418:0:8038:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874828700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8038:1873947616367360:0@lo:502: 00000040:00080000:2.0:1787135823.862471:0:8038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787135823.862792:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787135823.862815:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787135823.862826:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202324 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135823.862837:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202324 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787135823.862847:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787135823.862850:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e98456a5800 from 5 10000000:01000000:1.0:1787135823.862853:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787135823.862903:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135823.862911:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135823.862920:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135823.862950:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616367488:0@lo:101: 00000100:00100000:1.0:1787135823.863013:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135823.868678:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98533a6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787135823.870158:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616367488 00000100:00100000:0.0:1787135823.870171:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616367488 00000100:00100000:0.0:1787135823.870230:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787135823.870251:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616367488:12345-0@lo:101: 00010000:00010000:0.0:1787135823.870269:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135823.870289:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9840031200/0xf5850c552f202332 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20232b expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.870323:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9840031200/0xf5850c552f202332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20232b expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.870334:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9840031200/0xf5850c552f202332 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20232b expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.870343:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9840031200, rc 0) 00000100:00100000:0.0:1787135823.870413:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616367488:12345-0@lo:101: Request processed in 164us (7399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135823.870420:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787135823.870462:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616367488:0@lo:101: 00010000:00010000:0.0:1787135823.870479:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.870489:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135823.870553:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616367616:0@lo:256: 00000100:00100000:0.0:1787135823.870592:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135823.870612:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787135823.870629:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616367616 00000100:00100000:0.0:1787135823.870632:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616367616 00000100:00100000:0.0:1787135823.870648:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787135823.870653:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616367616:12345-0@lo:256: 20000000:01000000:0.0:1787135823.870666:0:5816:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787135823.870683:0:5816:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787135823.870686:0:5816:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1787135823.870767:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616367616:12345-0@lo:256: Request processed in 112us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135823.870775:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787135823.870796:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616367616:0@lo:256: 10000000:01000000:0.0:1787135823.870834:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787135823.870842:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.870851:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135823.870858:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787135823.870861:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1787135823.870863:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787135823.871410:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.871428:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.871437:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135823.871451:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616367744:0@lo:101: 00000100:00100000:0.0:1787135823.871481:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135823.871492:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787135823.871581:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616367744 00000100:00100000:3.0:1787135823.871586:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616367744 00000100:00100000:3.0:1787135823.871734:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787135823.871741:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616367744:12345-0@lo:101: 00010000:00010000:3.0:1787135823.871750:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135823.871760:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98820e2400/0xf5850c552f202340 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202339 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.871777:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98820e2400/0xf5850c552f202340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202339 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.871785:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98820e2400/0xf5850c552f202340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202339 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135823.871799:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e2400, rc 0) 00000100:00100000:3.0:1787135823.871826:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616367744:12345-0@lo:101: Request processed in 85us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135823.871832:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787135823.873007:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616367744:0@lo:101: 00010000:00010000:0.0:1787135823.873026:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202340 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.873037:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202340 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135823.873115:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616367872:0@lo:501: 00000100:00100000:0.0:1787135823.873157:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135823.873176:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787135823.873206:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616367872 00000100:00100000:0.0:1787135823.873210:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616367872 00000100:00100000:0.0:1787135823.873247:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787135823.873253:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616367872:12345-0@lo:501: 00000100:00100000:0.0:1787135823.873489:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616367872:12345-0@lo:501: Request processed in 236us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135823.873496:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787135823.873526:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616367872:0@lo:501: 00000100:00100000:0.0:1787135823.873549:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616368000:0@lo:503: 00000100:00100000:0.0:1787135823.873584:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135823.873593:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787135823.873608:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616368000 00000100:00100000:0.0:1787135823.873611:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616368000 00000100:00100000:0.0:1787135823.873624:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787135823.873628:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616368000:12345-0@lo:503: 00000100:00100000:0.0:1787135823.874980:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616368000:12345-0@lo:503: Request processed in 244us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135823.874995:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787135823.875168:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616368000:0@lo:503: 00000100:00100000:2.0:1787135823.877630:0:8040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874828700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8040:1873947616368128:0@lo:502: 00000100:00100000:2.0:1787135823.877704:0:8040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135823.877744:0:8040:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135823.877803:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616368128 00000100:00100000:3.0:1787135823.877810:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616368128 00000100:00100000:3.0:1787135823.877853:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1787135823.877861:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+18:8040:x1873947616368128:12345-0@lo:502: 00000100:00100000:2.0:1787135823.880087:0:8040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874828700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8040:1873947616368128:0@lo:502: 00000020:01000000:2.0:1787135823.880128:0:8040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787135823.880136:0:8040:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787135823.880142:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787135823.880145:0:8040:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787135823.880149:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787135823.880153:0:8040:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:2.0:1787135823.880174:0:8040:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787135823.880177:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787135823.880200:0:8040:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e98434699c0) 00000020:00000080:2.0:1787135823.880221:0:8040:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787135823.880230:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787135823.880316:0:8040:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787135823.880321:0:8040:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787135823.880328:0:8040:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f20234e 00010000:00080000:2.0:1787135823.880356:0:8040:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8e987486d800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1787135823.880565:0:8040:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787135823.880864:0:8040:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1787135823.881037:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+18:8040:x1873947616368128:12345-0@lo:502: Request processed in 2013us (2169us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135823.881061:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000040:01000000:2.0:1787135823.881472:0:8040:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787135823.882133:0:8040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787135823.882364:0:8040:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787135823.882416:0:8040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787135823.882476:0:8040:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000020:00000080:1.0:1787135823.883557:0:8040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787135823.883571:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787135823.883601:0:8040:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787135823.883622:0:8040:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5850c552f202355 00000100:00080000:1.0:1787135823.883632:0:8040:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787135823.883638:0:8040:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e987486d800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1787135823.883671:0:8040:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e987497a300 x1873947616368256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787135823.883692:0:8040:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787135823.883731:0:8040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787135823.883735:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787135823.883737:0:8040:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787135823.883740:0:8040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787135823.883743:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787135823.883745:0:8040:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787135823.883748:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787135823.883750:0:8040:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787135823.883775:0:8040:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8040:1873947616368384:0@lo:502: 00000100:00100000:1.0:1787135823.883848:0:8040:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135823.883898:0:8040:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98533a63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135823.884363:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616368256:0@lo:8: 00000100:00100000:2.0:1787135823.884404:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135823.884452:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616368640:0@lo:400: 00000100:00100000:2.0:1787135823.884478:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135823.884498:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787135823.884503:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616368512:0@lo:400: 00000100:00100000:2.0:1787135823.884532:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135823.884558:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616368896:0@lo:400: 00000100:00100000:2.0:1787135823.884580:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135823.884596:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787135823.884601:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616368768:0@lo:400: 00000100:00100000:2.0:1787135823.884621:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135823.884648:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616368640 00000100:00100000:2.0:1787135823.884655:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616368640 00000100:00100000:2.0:1787135823.884699:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616368512 00000100:00100000:2.0:1787135823.884703:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616368512 00000100:00100000:2.0:1787135823.884715:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616368896 00000100:00100000:2.0:1787135823.884717:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616368896 00000100:00100000:2.0:1787135823.884733:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787135823.884741:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616368640:12345-0@lo:400: 00000100:00100000:2.0:1787135823.884794:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987482bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616368640:12345-0@lo:400: Request processed in 53us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135823.884802:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787135823.884817:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787135823.884822:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616368512:12345-0@lo:400: 00000100:00100000:2.0:1787135823.884845:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616368512:12345-0@lo:400: Request processed in 24us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135823.884851:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787135823.884861:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787135823.884867:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616368896:12345-0@lo:400: 00000100:00100000:2.0:1787135823.884912:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616368896:12345-0@lo:400: Request processed in 45us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135823.884918:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787135823.885015:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616368256 00000100:00100000:1.0:1787135823.885020:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616368256 00000100:00100000:1.0:1787135823.885040:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616368768 00000100:00100000:1.0:1787135823.885042:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616368768 00000100:00100000:1.0:1787135823.885080:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787135823.885094:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616368768:12345-0@lo:400: 00000100:00100000:1.0:1787135823.885127:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616368768:12345-0@lo:400: Request processed in 35us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135823.885133:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787135823.885145:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787135823.885149:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1873947616368256:12345-0@lo:8: 00010000:00080000:1.0:1787135823.885168:0:6673:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:1.0:1787135823.885193:0:6673:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5850c552f20235c 00002000:00100000:1.0:1787135823.885207:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e987486b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113908 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1787135823.885211:0:6673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1787135823.885215:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787135823.885346:0:6673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787135823.885489:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787135823.885513:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8e9874868800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787135823.885556:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874828700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1873947616368256:12345-0@lo:8: Request processed in 406us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135823.885563:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787135823.885708:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787135823.885713:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787135823.885744:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9874979c00 x1873947616368512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135823.885759:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616368512:0@lo:400: 00010000:00080000:2.0:1787135823.885770:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987497b480 x1873947616368640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135823.885779:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616368640:0@lo:400: 00010000:00080000:2.0:1787135823.885810:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9874979880 x1873947616368768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135823.885819:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616368768:0@lo:400: 00010000:00080000:2.0:1787135823.885829:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987497ad80 x1873947616368896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135823.885837:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616368896:0@lo:400: 00010000:00080000:2.0:1787135823.885860:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987497a300 x1873947616368256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787135833 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135823.885867:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787135823.885883:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787135823.885891:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787135823.885895:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787135823.885897:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e987486d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787135823.886002:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787135823.886008:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616368256:0@lo:8: 00000040:00080000:2.0:1787135823.886126:0:8041:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787135823.886131:0:8041:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1787135823.886182:0:8041:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787135823.886274:0:8041:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 183829225220ns, next at 0ns, rc = 0 00000100:00100000:0.0:1787135823.887603:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616368384 00000100:00100000:0.0:1787135823.887616:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616368384 00000100:00100000:0.0:1787135823.887668:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787135823.887677:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:8040:x1873947616368384:12345-0@lo:502: 00000100:00100000:0.0:1787135823.890899:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:8040:x1873947616368384:12345-0@lo:502: Request processed in 3215us (7042us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135823.890913:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787135823.891019:0:8040:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8040:1873947616368384:0@lo:502: 00000020:01000000:0.0:1787135823.891067:0:8040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787135823.891074:0:8040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135823.891076:0:8040:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787135823.891082:0:8040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1787135823.891148:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1787135823.891167:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787135823.891184:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202340 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.891195:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202340 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135823.891205:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787135823.891208:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8e9860760000 from 1 10000000:01000000:0.0:1787135823.891210:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787135823.891252:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.891260:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.891270:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135823.891286:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616369024:0@lo:101: 00000100:00100000:0.0:1787135823.891332:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135823.891363:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787135823.891437:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616369024 00000100:00100000:0.0:1787135823.891443:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616369024 00000100:00100000:0.0:1787135823.891474:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787135823.891482:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616369024:12345-0@lo:101: 00010000:00010000:0.0:1787135823.891494:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135823.891505:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9840030a00/0xf5850c552f20236a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202363 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.891528:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9840030a00/0xf5850c552f20236a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202363 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.891546:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9840030a00/0xf5850c552f20236a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202363 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.891554:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9840030a00, rc 0) 00000100:00100000:0.0:1787135823.891586:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616369024:12345-0@lo:101: Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135823.891592:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787135823.891616:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616369024:0@lo:101: 00010000:00010000:0.0:1787135823.891627:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20236a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.891637:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20236a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135823.891678:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616369152:0@lo:501: 00000100:00100000:0.0:1787135823.891701:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135823.891709:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787135823.891724:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616369152 00000100:00100000:0.0:1787135823.891727:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616369152 00000100:00100000:0.0:1787135823.891743:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787135823.891748:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616369152:12345-0@lo:501: 00000100:00100000:0.0:1787135823.891917:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616369152:12345-0@lo:501: Request processed in 169us (215us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787135823.891923:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787135823.893043:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616369152:0@lo:501: 10000000:01000000:0.0:1787135823.893101:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787135823.893116:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20236a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135823.893124:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20236a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787135823.928682:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1787135823.963691:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787135823.968880:0:8042:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1787135823.968913:0:8042:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1873947616369408:0@lo:7: 00000100:00100000:0.0:1787135823.968988:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135823.969030:0:8042:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2840 going to sleep for 11 seconds 00000100:00100000:2.0:1787135823.969163:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616369280:0@lo:13: 00000100:00100000:2.0:1787135823.969195:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135823.969901:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616369280 00000100:00100000:0.0:1787135823.969909:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616369280 00000100:00100000:0.0:1787135823.969976:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787135823.969986:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1873947616369280:12345-0@lo:13: 00002000:00000024:0.0:1787135823.970018:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787135823.970087:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987482aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3300:x1873947616369280:12345-0@lo:13: Request processed in 102us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135823.970094:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1787135823.970214:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787135823.970254:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd35500 x1873947616369280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135823.970273:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616369280:0@lo:13: 00000100:00100000:0.0:1787135823.971179:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616369408 00000100:00100000:0.0:1787135823.971187:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616369408 00000100:00100000:0.0:1787135823.971229:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787135823.971248:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8042:x1873947616369408:12345-0@lo:7: 00002000:00080000:0.0:1787135823.988660:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1787135823.988669:0:6673:0:(ofd_dev.c:1211:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787135823.988760:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8042:x1873947616369408:12345-0@lo:7: Request processed in 17510us (19768us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135823.988772:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787135823.988857:0:8042:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd37100 x1873947616369408/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787135839 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135823.988872:0:8042:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1873947616369408:0@lo:7: 00000004:00080000:0.0:1787135823.988886:0:8042:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787135823.988922:0:8042:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1873947616369536:0@lo:5: 00000100:00100000:0.0:1787135823.989215:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135823.989269:0:8042:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2840 going to sleep for 11 seconds 00000100:00100000:3.0:1787135823.989332:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616369536 00000100:00100000:3.0:1787135823.989338:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616369536 00000100:00100000:3.0:1787135823.989389:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787135823.989400:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8042:x1873947616369536:12345-0@lo:5: 00002000:00080000:3.0:1787135823.989424:0:6672:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787135823.989428:0:6672:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787135823.989684:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8042:x1873947616369536:12345-0@lo:5: Request processed in 286us (467us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787135823.989691:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787135823.989723:0:8042:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd37100 x1873947616369536/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787135839 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135823.989735:0:8042:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1873947616369536:0@lo:5: 00000004:00080000:3.0:1787135823.989745:0:8042:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787135823.989768:0:8042:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd56300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1873947616369664:0@lo:700: 00000100:00100000:3.0:1787135823.989800:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135823.989816:0:8042:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457dbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135823.989830:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616369664 00000100:00100000:3.0:1787135823.989834:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616369664 00000100:00100000:3.0:1787135823.989867:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787135823.990032:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8042:x1873947616369664:12345-0@lo:700: 00000100:00100000:3.0:1787135823.990081:0:6681:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6681:1873947616369792:0@lo:700: 00000100:00100000:3.0:1787135823.990111:0:6681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135823.990129:0:6681:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457dbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787135823.990142:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616369792 00000100:00100000:3.0:1787135823.990145:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616369792 00000100:00100000:3.0:1787135823.990169:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787135823.990176:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6681:x1873947616369792:12345-0@lo:700: 40000000:02000000:3.0:1787135824.038133:0:5828:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1787135824.045695:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6681:x1873947616369792:12345-0@lo:700: Request processed in 55510us (55573us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135824.045708:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787135824.052242:0:6681:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd54e00 x1873947616369792/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787135839 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135824.052261:0:6681:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd54e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6681:1873947616369792:0@lo:700: 40000000:02000000:1.0:1787135824.052277:0:6681:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1787135824.136017:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787135824.136037:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1787135824.136328:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8042:x1873947616369664:12345-0@lo:700: Request processed in 146450us (146522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135824.136345:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787135824.136417:0:8042:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd56300 x1873947616369664/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787135839 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135824.136428:0:8042:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1787135824.136444:0:8042:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd56300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1873947616369664:0@lo:700: 00000004:02000040:3.0:1787135824.192681:0:8042:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787135824.199264:0:8042:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1873947616369920:0@lo:5: 00000100:00100000:2.0:1787135824.199336:0:8042:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135824.199394:0:8042:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c26c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135824.199445:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616369920 00000100:00100000:3.0:1787135824.199452:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616369920 00000100:00100000:3.0:1787135824.199533:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787135824.199543:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987482b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8042:x1873947616369920:12345-0@lo:5: 00002000:00080000:3.0:1787135824.207573:0:6673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787135824.209318:0:6673:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1787135824.216912:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987482b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8042:x1873947616369920:12345-0@lo:5: Request processed in 17364us (17569us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787135824.216940:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787135824.218428:0:8042:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987482a300 x1873947616369920/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787135840 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135824.218448:0:8042:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8042:1873947616369920:0@lo:5: 00000004:00080000:0.0:1787135824.218464:0:8042:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1787135824.345041:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787135824.345085:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616370048:0@lo:13: 00000100:00100000:3.0:1787135824.345150:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135824.345356:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616370048 00000100:00100000:0.0:1787135824.345365:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616370048 00000100:00100000:0.0:1787135824.345413:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787135824.345424:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616370048:12345-0@lo:13: 00002000:00000024:0.0:1787135824.345456:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135824.345508:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616370048:12345-0@lo:13: Request processed in 86us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135824.345515:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787135824.345598:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd36a00 x1873947616370048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135824.345618:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616370048:0@lo:13: 00010000:00010000:3.0:1787135824.984753:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135826.023403:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135827.033125:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787135827.545321:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1787135828.057004:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135828.952376:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616370176:0@lo:400: 00000100:00100000:3.0:1787135828.952451:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135828.954163:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616370304:0@lo:400: 00000100:00100000:2.0:1787135828.954232:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135828.954290:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616370304 00000100:00100000:2.0:1787135828.954297:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616370304 00000100:00100000:2.0:1787135828.954346:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787135828.954355:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987482b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616370304:12345-0@lo:400: 00000100:00100000:2.0:1787135828.954410:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987482b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616370304:12345-0@lo:400: Request processed in 55us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135828.954417:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1787135828.958156:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd36a00 x1873947616370304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135828.958241:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616370304:0@lo:400: 00000100:00100000:1.0:1787135828.958421:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616370176 00000100:00100000:1.0:1787135828.958430:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616370176 00000100:00100000:1.0:1787135828.958499:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787135828.958509:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616370176:12345-0@lo:400: 00000100:00100000:0.0:1787135828.961495:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616370560:0@lo:400: 00000100:00100000:0.0:1787135828.961568:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135828.961606:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787135828.961612:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616370432:0@lo:400: 00000100:00100000:0.0:1787135828.961803:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135828.961853:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616370560 00000100:00100000:0.0:1787135828.961873:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616370560 00000100:00100000:0.0:1787135828.961971:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787135828.961985:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616370560:12345-0@lo:400: 00000100:00100000:0.0:1787135828.962077:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616370560:12345-0@lo:400: Request processed in 95us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135828.962084:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787135828.962106:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616370432 00000100:00100000:0.0:1787135828.962109:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616370432 00000100:00100000:0.0:1787135828.962136:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787135828.962143:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616370432:12345-0@lo:400: 00000100:00100000:0.0:1787135828.962174:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616370432:12345-0@lo:400: Request processed in 32us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135828.962180:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1787135828.962195:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787135828.962210:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787135828.962239:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd37100 x1873947616370432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135828.962253:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616370432:0@lo:400: 00010000:00080000:0.0:1787135828.962266:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd35500 x1873947616370560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135828.962296:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616370560:0@lo:400: 00000100:00100000:0.0:1787135828.962324:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616370816:0@lo:400: 00000100:00100000:0.0:1787135828.962419:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135828.962456:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787135828.962494:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616370816 00000100:00100000:2.0:1787135828.962499:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616370816 00000100:00100000:2.0:1787135828.962530:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787135828.962537:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616370816:12345-0@lo:400: 00000100:00100000:2.0:1787135828.962571:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616370816:12345-0@lo:400: Request processed in 35us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135828.962576:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787135828.962677:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616370688:0@lo:400: 00000100:00100000:0.0:1787135828.962707:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787135828.962765:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9881fc2680 x1873947616370816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135828.962779:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1787135828.962797:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616370816:0@lo:400: 00000100:00080000:0.0:1787135828.962815:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787135828.963850:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616370688 00000100:00100000:2.0:1787135828.963863:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616370688 00000100:00100000:2.0:1787135828.963945:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1787135828.963953:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135828.963965:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616370688:12345-0@lo:400: 00000100:00100000:2.0:1787135828.964080:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616370688:12345-0@lo:400: Request processed in 124us (1371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135828.964088:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787135828.964210:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd36a00 x1873947616370688/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787135844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135828.964226:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616370688:0@lo:400: 00000100:00100000:1.0:1787135828.964348:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616370176:12345-0@lo:400: Request processed in 5838us (11894us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135828.964359:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787135828.964364:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616370176:0@lo:400: 00010000:00010000:3.0:1787135829.082847:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135829.162295:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135829.163578:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595374976 00000100:00100000:0.0:1787135829.163591:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595374976 00000100:00100000:0.0:1787135829.163649:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:0.0:1787135829.163658:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1873947595374976:12345-192.168.203.38@tcp:250: 00010000:00080000:0.0:1787135829.163685:0:5816:0:(ldlm_lib.c:1449:target_handle_connect()) MGS: connection from ccb52158-7d35-4065-a26d-1bb142899404@192.168.203.38@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1787135829.163718:0:5816:0:(genops.c:1406:class_connect()) connect: client ccb52158-7d35-4065-a26d-1bb142899404, cookie 0xf5850c552f202371 00000100:00080000:0.0:1787135829.164138:0:5816:0:(import.c:65:import_set_state_nolock()) ffff8e9746925000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787135829.164268:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+5:2358:x1873947595374976:12345-192.168.203.38@tcp:250: Request processed in 610us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135829.164277:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:0.0:1787135829.183795:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135829.184721:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595374848 00000100:00100000:1.0:1787135829.184733:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595374848 00000100:00100000:1.0:1787135829.184783:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:1.0:1787135829.184794:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+5:5586:x1873947595374848:12345-192.168.203.38@tcp:101: 00010000:00010000:1.0:1787135829.184810:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135829.184826:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841489c00/0xf5850c552f202378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b7180cc expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135829.184855:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841489c00/0xf5850c552f202378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180cc expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135829.184877:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841489c00/0xf5850c552f202378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180cc expref: 6 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135829.184886:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841489c00, rc 0) 00000100:00100000:1.0:1787135829.185637:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+6:5586:x1873947595374848:12345-192.168.203.38@tcp:101: Request processed in 843us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135829.185645:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:3.0:1787135829.193437:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135829.193534:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595375104 00000100:00100000:2.0:1787135829.193551:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595375104 00000100:00100000:2.0:1787135829.193608:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:2.0:1787135829.193617:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+6:5586:x1873947595375104:12345-192.168.203.38@tcp:501: 00000100:00100000:2.0:1787135829.194003:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+6:5586:x1873947595375104:12345-192.168.203.38@tcp:501: Request processed in 384us (573us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787135829.194013:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:3.0:1787135829.206992:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135829.207467:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595375232 00000100:00100000:1.0:1787135829.207478:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595375232 00000100:00100000:1.0:1787135829.207556:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:1.0:1787135829.207567:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+6:5586:x1873947595375232:12345-192.168.203.38@tcp:101: 00010000:00010000:1.0:1787135829.207585:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135829.207605:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841488600/0xf5850c552f20237f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b7180d3 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135829.207646:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841488600/0xf5850c552f20237f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180d3 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135829.207658:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841488600/0xf5850c552f20237f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180d3 expref: 7 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135829.207667:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841488600, rc 0) 00000100:00100000:1.0:1787135829.207726:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+7:5586:x1873947595375232:12345-192.168.203.38@tcp:101: Request processed in 161us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135829.207733:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:3.0:1787135829.213771:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135829.213873:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595375360 00000100:00100000:0.0:1787135829.213883:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595375360 00000100:00100000:0.0:1787135829.213944:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:0.0:1787135829.213954:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+7:5586:x1873947595375360:12345-192.168.203.38@tcp:501: 00000100:00100000:0.0:1787135829.214315:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+8:5586:x1873947595375360:12345-192.168.203.38@tcp:501: Request processed in 361us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135829.214333:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:3.0:1787135829.218934:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135829.219681:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595375488 00000100:00100000:2.0:1787135829.219691:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595375488 00000100:00100000:2.0:1787135829.219750:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:2.0:1787135829.219785:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+8:5586:x1873947595375488:12345-192.168.203.38@tcp:503: 00000100:00100000:2.0:1787135829.221275:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+8:5586:x1873947595375488:12345-192.168.203.38@tcp:503: Request processed in 1484us (2342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135829.221287:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:3.0:1787135829.230742:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135829.238279:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595375616 00000100:00100000:2.0:1787135829.238295:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595375616 00000100:00100000:2.0:1787135829.238377:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:2.0:1787135829.238388:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+8:5606:x1873947595375616:12345-192.168.203.38@tcp:502: 00000100:00100000:2.0:1787135829.238750:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+8:5606:x1873947595375616:12345-192.168.203.38@tcp:502: Request processed in 363us (8015us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135829.238759:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:3.0:1787135829.287223:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135829.290254:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595375744 00000100:00100000:2.0:1787135829.290269:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595375744 00000100:00100000:2.0:1787135829.290342:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:2.0:1787135829.290352:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+8:5606:x1873947595375744:12345-192.168.203.38@tcp:502: 00000100:00100000:2.0:1787135829.290834:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+8:5606:x1873947595375744:12345-192.168.203.38@tcp:502: Request processed in 481us (3619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135829.290845:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:3.0:1787135829.305287:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135829.309176:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595375872 00000100:00100000:0.0:1787135829.309191:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595375872 00000100:00100000:1.0:1787135829.309519:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:1.0:1787135829.309531:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+8:5586:x1873947595375872:12345-192.168.203.38@tcp:101: 00010000:00010000:1.0:1787135829.309556:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135829.309574:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841488000/0xf5850c552f202386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b7180fd expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135829.309601:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841488000/0xf5850c552f202386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180fd expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135829.309612:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841488000/0xf5850c552f202386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180fd expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135829.309639:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841488000, rc 0) 00000100:00100000:1.0:1787135829.309706:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+9:5586:x1873947595375872:12345-192.168.203.38@tcp:101: Request processed in 178us (4428us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135829.309713:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:3.0:1787135829.313116:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135829.313510:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595376000 00000100:00100000:1.0:1787135829.313521:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595376000 00000100:00100000:1.0:1787135829.313575:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:1.0:1787135829.313585:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+9:5586:x1873947595376000:12345-192.168.203.38@tcp:256: 20000000:01000000:1.0:1787135829.313610:0:5815:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787135829.313632:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787135829.313636:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787135829.313640:0:5815:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787135829.313642:0:5815:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787135829.315250:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+9:5586:x1873947595376000:12345-192.168.203.38@tcp:256: Request processed in 1596us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135829.315264:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:3.0:1787135829.322266:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135829.322567:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595376128 00000100:00100000:1.0:1787135829.322577:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595376128 00000100:00100000:1.0:1787135829.322632:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:1.0:1787135829.322643:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+9:5586:x1873947595376128:12345-192.168.203.38@tcp:101: 00010000:00010000:1.0:1787135829.322660:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135829.322676:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841489200/0xf5850c552f20238d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b718104 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135829.322702:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841489200/0xf5850c552f20238d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718104 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135829.322732:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841489200/0xf5850c552f20238d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718104 expref: 10 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135829.322742:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841489200, rc 0) 00000100:00100000:1.0:1787135829.322807:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:5586:x1873947595376128:12345-192.168.203.38@tcp:101: Request processed in 165us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135829.322813:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:3.0:1787135829.324917:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135829.325148:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595376256 00000100:00100000:1.0:1787135829.325158:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595376256 00000100:00100000:1.0:1787135829.325218:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:1.0:1787135829.325228:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:5586:x1873947595376256:12345-192.168.203.38@tcp:501: 00000100:00100000:1.0:1787135829.326215:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:5586:x1873947595376256:12345-192.168.203.38@tcp:501: Request processed in 984us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135829.326226:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:3.0:1787135829.328692:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135829.330038:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595376384 00000100:00100000:2.0:1787135829.330063:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595376384 00000100:00100000:2.0:1787135829.330221:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:2.0:1787135829.330233:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:5586:x1873947595376384:12345-192.168.203.38@tcp:503: 00000100:00100000:2.0:1787135829.331316:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:5586:x1873947595376384:12345-192.168.203.38@tcp:503: Request processed in 1081us (2627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135829.331328:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:3.0:1787135829.344708:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135829.345324:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595376512 00000100:00100000:1.0:1787135829.345335:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595376512 00000100:00100000:1.0:1787135829.345400:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:1.0:1787135829.345410:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:5610:x1873947595376512:12345-192.168.203.38@tcp:502: 00000100:00100000:1.0:1787135829.345679:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:5610:x1873947595376512:12345-192.168.203.38@tcp:502: Request processed in 270us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135829.345688:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:2.0:1787135829.349453:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135829.349647:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595376640 00000100:00100000:0.0:1787135829.349658:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595376640 00000100:00100000:0.0:1787135829.349715:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:0.0:1787135829.349725:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:5610:x1873947595376640:12345-192.168.203.38@tcp:502: 00000100:00100000:0.0:1787135829.349982:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:5610:x1873947595376640:12345-192.168.203.38@tcp:502: Request processed in 258us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135829.349990:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:3.0:1787135829.354109:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135829.354487:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595376768 00000100:00100000:0.0:1787135829.354497:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595376768 00000100:00100000:0.0:1787135829.354551:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:0.0:1787135829.354559:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2358:x1873947595376768:12345-192.168.203.38@tcp:38: 00010000:00080000:0.0:1787135829.354586:0:5823:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:0.0:1787135829.354629:0:5823:0:(genops.c:1406:class_connect()) connect: client a1006dc5-9c90-4762-af1c-1ab0be9a05b8, cookie 0xf5850c552f202394 00000004:00100000:0.0:1787135829.354655:0:5823:0:(mdt_handler.c:7486:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787135829.354661:0:5823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1787135829.395040:0:5823:0:(import.c:65:import_set_state_nolock()) ffff8e984758e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787135829.395703:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2358:x1873947595376768:12345-192.168.203.38@tcp:38: Request processed in 41140us (41611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135829.395715:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:1.0:1787135829.464448:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787135829.464476:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616370944:0@lo:13: 00000100:00100000:1.0:1787135829.464558:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135829.464678:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616370944 00000100:00100000:0.0:1787135829.464686:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616370944 00000100:00100000:0.0:1787135829.464736:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787135829.464746:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616370944:12345-0@lo:13: 00002000:00000024:0.0:1787135829.464792:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135829.464845:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616370944:12345-0@lo:13: Request processed in 100us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135829.464853:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787135829.465215:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787135829.465225:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616371072:0@lo:13: 00000100:00100000:2.0:1787135829.465256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135829.465358:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616371072 00000100:00100000:0.0:1787135829.465363:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616371072 00000100:00100000:0.0:1787135829.465392:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787135829.465398:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616371072:12345-0@lo:13: 00002000:00000024:0.0:1787135829.465418:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135829.465457:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874829f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616371072:12345-0@lo:13: Request processed in 57us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135829.465463:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1787135829.465581:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9881fc2680 x1873947616370944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135829.465609:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616370944:0@lo:13: 00010000:00080000:2.0:1787135829.465734:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9881fc1c00 x1873947616371072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135829.465745:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616371072:0@lo:13: 00010000:00010000:1.0:1787135830.104237:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135830.402321:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135830.402499:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595377024 00000100:00100000:0.0:1787135830.402511:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595377024 00000100:00100000:0.0:1787135830.402588:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:0.0:1787135830.402599:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:5586:x1873947595377024:12345-192.168.203.38@tcp:41: 00000004:00000024:0.0:1787135830.402644:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787135830.402720:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:5586:x1873947595377024:12345-192.168.203.38@tcp:41: Request processed in 123us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135830.402727:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00080000:2.0:1787135830.403137:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135830.407196:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135830.407780:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135830.408099:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595376896 00000100:00100000:2.0:1787135830.408109:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595376896 00000100:00100000:2.0:1787135830.408167:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595377152 00000100:00100000:2.0:1787135830.408170:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595377152 00000100:00100000:2.0:1787135830.408202:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1787135830.408213:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:0:x1873947595376896:12345-192.168.203.38@tcp:41: 00000004:00000024:2.0:1787135830.408241:0:7623:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787135830.408312:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:0:x1873947595376896:12345-192.168.203.38@tcp:41: Request processed in 102us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135830.408319:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1787135830.408336:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1787135830.408341:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:5586:x1873947595377152:12345-192.168.203.38@tcp:40: 00000100:00100000:2.0:1787135830.408365:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:5586:x1873947595377152:12345-192.168.203.38@tcp:40: Request processed in 24us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135830.408371:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1787135830.411698:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135830.411740:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135830.411769:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135830.411810:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135830.412208:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595377280 00000100:00100000:0.0:1787135830.412219:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595377280 00000100:00100000:0.0:1787135830.412262:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595377408 00000100:00100000:0.0:1787135830.412265:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595377408 00000100:00100000:0.0:1787135830.412288:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1787135830.412296:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873947595377280:12345-192.168.203.38@tcp:8: 00010000:00080000:0.0:1787135830.412324:0:6672:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1787135830.412364:0:6672:0:(genops.c:1406:class_connect()) connect: client a1006dc5-9c90-4762-af1c-1ab0be9a05b8, cookie 0xf5850c552f20239b 00002000:00100000:0.0:1787135830.412376:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a1006dc5-9c90-4762-af1c-1ab0be9a05b8/ffff8e984758c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113908 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787135830.412386:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787135830.412694:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787135830.412724:0:6672:0:(import.c:65:import_set_state_nolock()) ffff8e9842bc7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787135830.412785:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2358:x1873947595377280:12345-192.168.203.38@tcp:8: Request processed in 487us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135830.412793:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1787135830.412810:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1787135830.412815:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873947595377408:12345-192.168.203.38@tcp:8: 00010000:00080000:0.0:1787135830.412829:0:6672:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1787135830.412847:0:6672:0:(genops.c:1406:class_connect()) connect: client a1006dc5-9c90-4762-af1c-1ab0be9a05b8, cookie 0xf5850c552f2023a2 00002000:00100000:0.0:1787135830.412853:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a1006dc5-9c90-4762-af1c-1ab0be9a05b8/ffff8e9842bc6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113908 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787135830.412859:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787135830.413269:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787135830.413301:0:6672:0:(import.c:65:import_set_state_nolock()) ffff8e9852e58000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787135830.413328:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2358:x1873947595377408:12345-192.168.203.38@tcp:8: Request processed in 512us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135830.413336:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1787135830.413361:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595377664 00000100:00100000:0.0:1787135830.413366:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595377664 00000100:00100000:0.0:1787135830.413399:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:0.0:1787135830.413406:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:2359:x1873947595377664:12345-192.168.203.38@tcp:400: 00000100:00100000:0.0:1787135830.413431:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:2359:x1873947595377664:12345-192.168.203.38@tcp:400: Request processed in 26us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135830.413444:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:2.0:1787135830.414330:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595377536 00000100:00100000:2.0:1787135830.414339:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595377536 00000100:00100000:2.0:1787135830.414386:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1787135830.414394:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:5586:x1873947595377536:12345-192.168.203.38@tcp:33: 00000004:00080000:0.0:1787135830.450367:0:5824:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 35906us 00000004:00200000:1.0:1787135830.485476:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787135830.487088:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:5586:x1873947595377536:12345-192.168.203.38@tcp:33: Request processed in 72686us (75390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135830.487104:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:1.0:1787135830.732316:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135830.732417:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595377792 00000100:00100000:2.0:1787135830.732427:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595377792 00000100:00100000:2.0:1787135830.732499:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1787135830.732509:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:5627:x1873947595377792:12345-192.168.203.38@tcp:101: 00010000:00010000:2.0:1787135830.732528:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135830.732608:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2023a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71812e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135830.732673:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2023b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135830.732687:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2023b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135830.732701:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2023b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135830.732891:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787135830.732896:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135830.732984:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2023b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135830.733012:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2023a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71812e expref: 8 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135830.733141:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2023b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71812e expref: 7 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135830.733151:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98532d1200) 00010000:00010000:2.0:1787135830.733161:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787135830.733165:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6200, rc 0) 00000100:00100000:2.0:1787135830.733233:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:5627:x1873947595377792:12345-192.168.203.38@tcp:101: Request processed in 726us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135830.733241:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00010000:00010000:3.0:1787135831.128486:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135832.152208:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135833.176301:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135833.192276:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135833.192368:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595377920 00000100:00100000:3.0:1787135833.192379:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595377920 00000100:00100000:3.0:1787135833.192457:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1787135833.192467:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:5679:x1873947595377920:12345-192.168.203.38@tcp:41: 00000004:00000024:3.0:1787135833.192532:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787135833.192605:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:5679:x1873947595377920:12345-192.168.203.38@tcp:41: Request processed in 139us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135833.192614:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00080000:2.0:1787135833.192891:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135833.195762:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135833.195831:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595378048 00000100:00100000:0.0:1787135833.195840:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595378048 00000100:00100000:0.0:1787135833.195914:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1787135833.195926:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:5679:x1873947595378048:12345-192.168.203.38@tcp:13: 00002000:00000024:0.0:1787135833.195960:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135833.196026:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:5679:x1873947595378048:12345-192.168.203.38@tcp:13: Request processed in 102us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135833.196034:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00080000:2.0:1787135833.196268:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787135833.200125:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135833.200220:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595378176 00000100:00100000:0.0:1787135833.200230:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595378176 00000100:00100000:0.0:1787135833.200359:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:0.0:1787135833.200369:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:5679:x1873947595378176:12345-192.168.203.38@tcp:13: 00002000:00000024:0.0:1787135833.200420:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135833.200503:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:5679:x1873947595378176:12345-192.168.203.38@tcp:13: Request processed in 135us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135833.200520:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00080000:2.0:1787135833.207862:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1787135833.640137:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000100:00100000:2.0:1787135834.072844:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616371456:0@lo:400: 00000100:00100000:1.0:1787135834.072845:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616371584:0@lo:400: 00000100:00100000:0.0:1787135834.072931:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616371328:0@lo:400: 00000100:00100000:2.0:1787135834.073003:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135834.073112:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616371456 00000100:00100000:2.0:1787135834.073120:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616371456 00000100:00100000:2.0:1787135834.073189:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787135834.073200:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987482a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616371456:12345-0@lo:400: 00000100:00100000:3.0:1787135834.073236:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616371200:0@lo:400: 00000100:00100000:3.0:1787135834.073276:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135834.073303:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616371712:0@lo:400: 00000100:00100000:3.0:1787135834.073325:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135834.073354:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616371712 00000100:00100000:3.0:1787135834.073358:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616371712 00000100:00100000:3.0:1787135834.073386:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787135834.073393:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616371712:12345-0@lo:400: 00000100:00100000:3.0:1787135834.073429:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616371712:12345-0@lo:400: Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135834.073437:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787135834.073475:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616371712:0@lo:400: 00000100:00100000:2.0:1787135834.073481:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987482a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616371456:12345-0@lo:400: Request processed in 281us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135834.073491:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787135834.073514:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135834.073537:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616371456:0@lo:400: 00000100:00100000:0.0:1787135834.073743:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135834.073766:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616371840:0@lo:400: 00000100:00100000:0.0:1787135834.073790:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135834.073841:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616371328 00000100:00100000:0.0:1787135834.073845:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616371328 00000100:00100000:0.0:1787135834.073870:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787135834.073881:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616371328:12345-0@lo:400: 00000100:00100000:0.0:1787135834.073919:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616371328:12345-0@lo:400: Request processed in 37us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135834.073925:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787135834.073963:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616371328:0@lo:400: 00000100:00100000:2.0:1787135834.075738:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616371840 00000100:00100000:2.0:1787135834.075750:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616371840 00000100:00100000:2.0:1787135834.075828:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787135834.075838:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616371840:12345-0@lo:400: 00000100:00100000:2.0:1787135834.075914:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616371840:12345-0@lo:400: Request processed in 77us (2121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135834.075921:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787135834.076120:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876cad500 x1873947616371840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135834.076135:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616371840:0@lo:400: 00000100:00100000:2.0:1787135834.076297:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616371200 00000100:00100000:2.0:1787135834.076301:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616371200 00000100:00100000:2.0:1787135834.076339:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1787135834.076345:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616371200:12345-0@lo:400: 00000100:00100000:2.0:1787135834.076385:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616371200:12345-0@lo:400: Request processed in 41us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135834.076392:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1787135834.076702:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787135834.076730:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616371200:0@lo:400: 00000100:00100000:1.0:1787135834.077740:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135834.077855:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616371584 00000100:00100000:3.0:1787135834.077861:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616371584 00000100:00080000:2.0:1787135834.078377:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787135834.079026:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787135834.079043:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616371584:12345-0@lo:400: 00000100:00100000:3.0:1787135834.079152:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616371584:12345-0@lo:400: Request processed in 116us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135834.079160:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1787135834.079611:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9874979c00 x1873947616371584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135834.079627:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616371584:0@lo:400: 00010000:00010000:0.0:1787135834.200895:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135834.585177:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616371968:0@lo:13: 00000100:00100000:3.0:1787135834.585253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135834.585326:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616371968 00000100:00100000:3.0:1787135834.585334:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616371968 00000100:00100000:3.0:1787135834.585377:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787135834.585385:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616371968:12345-0@lo:13: 00002000:00000024:3.0:1787135834.585406:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135834.585448:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616371968:12345-0@lo:13: Request processed in 63us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135834.585455:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787135834.585615:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9874829500 x1873947616371968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135834.585634:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616371968:0@lo:13: 00000100:00100000:1.0:1787135834.586270:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616372096:0@lo:13: 00000100:00100000:1.0:1787135834.586310:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135834.586390:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616372096 00000100:00100000:2.0:1787135834.586395:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616372096 00000100:00100000:2.0:1787135834.586432:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787135834.586440:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616372096:12345-0@lo:13: 00002000:00000024:2.0:1787135834.586453:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135834.586505:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616372096:12345-0@lo:13: Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135834.586512:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787135834.586540:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987482a680 x1873947616372096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135834.586553:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616372096:0@lo:13: 00000001:00100000:1.0:1787135834.717126:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000001:00100000:0.0:1787135835.189107:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00010000:00010000:3.0:1787135835.224229:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135835.496655:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135835.496696:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135835.496732:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135835.496860:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595378560 00000100:00100000:3.0:1787135835.496871:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595378560 00000100:00100000:3.0:1787135835.496931:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1787135835.496942:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595378560:12345-192.168.203.38@tcp:400: 00000100:00100000:3.0:1787135835.497018:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595378560:12345-192.168.203.38@tcp:400: Request processed in 78us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135835.497026:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00080000:3.0:1787135835.497064:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787135835.497418:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135835.497480:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595378688 00000100:00100000:3.0:1787135835.497485:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595378688 00000100:00100000:3.0:1787135835.497533:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:3.0:1787135835.497540:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595378688:12345-192.168.203.38@tcp:400: 00000100:00100000:3.0:1787135835.497574:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595378688:12345-192.168.203.38@tcp:400: Request processed in 35us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135835.497581:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00080000:1.0:1787135835.499827:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787135835.500082:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595378304 00000100:00100000:0.0:1787135835.500091:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595378304 00000100:00100000:0.0:1787135835.500135:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:0.0:1787135835.500145:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:2359:x1873947595378304:12345-192.168.203.38@tcp:400: 00000100:00100000:0.0:1787135835.500215:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:2359:x1873947595378304:12345-192.168.203.38@tcp:400: Request processed in 72us (3569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135835.500222:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:0.0:1787135835.500253:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595378432 00000100:00100000:0.0:1787135835.500257:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595378432 00000100:00100000:0.0:1787135835.500294:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:0.0:1787135835.500302:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595378432:12345-192.168.203.38@tcp:400: 00000100:00100000:0.0:1787135835.500331:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595378432:12345-192.168.203.38@tcp:400: Request processed in 30us (3599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135835.500347:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00080000:0.0:1787135835.500368:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1787135835.991429:0:8279:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787135836.248326:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135837.274339:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135838.296389:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135839.194271:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616372352:0@lo:400: 00000100:00100000:0.0:1787135839.194340:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135839.194387:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616372864:0@lo:400: 00000100:00100000:0.0:1787135839.194412:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135839.194443:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787135839.194450:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616372224:0@lo:400: 00000100:00100000:0.0:1787135839.194488:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135839.194510:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616372736:0@lo:400: 00000100:00100000:0.0:1787135839.194531:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135839.194558:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616372352 00000100:00100000:0.0:1787135839.194566:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616372352 00000100:00100000:0.0:1787135839.194605:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616372736 00000100:00100000:0.0:1787135839.194608:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616372736 00000100:00100000:0.0:1787135839.194636:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787135839.194644:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616372352:12345-0@lo:400: 00000100:00100000:0.0:1787135839.194694:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616372352:12345-0@lo:400: Request processed in 50us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135839.194702:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787135839.194718:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787135839.194724:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616372736:12345-0@lo:400: 00000100:00100000:0.0:1787135839.194750:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616372736:12345-0@lo:400: Request processed in 26us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135839.194768:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787135839.194786:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616372864 00000100:00100000:0.0:1787135839.194789:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616372864 00000100:00100000:0.0:1787135839.194815:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787135839.194836:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616372864:12345-0@lo:400: 00000100:00100000:0.0:1787135839.194867:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616372864:12345-0@lo:400: Request processed in 47us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135839.194873:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787135839.194888:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616372224 00000100:00100000:0.0:1787135839.194891:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616372224 00000100:00100000:0.0:1787135839.194914:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787135839.194920:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616372224:12345-0@lo:400: 00000100:00100000:0.0:1787135839.194947:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616372224:12345-0@lo:400: Request processed in 28us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135839.194953:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1787135839.194981:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787135839.194985:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135839.195015:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616372224:0@lo:400: 00000100:00100000:0.0:1787135839.195028:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616372736:0@lo:400: 00000100:00100000:0.0:1787135839.195037:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616372352:0@lo:400: 00010000:00080000:0.0:1787135839.195073:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9881fc0a80 x1873947616372864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135839.195084:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616372864:0@lo:400: 00000100:00100000:2.0:1787135839.196005:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616372608:0@lo:400: 00000100:00100000:2.0:1787135839.196570:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135839.196613:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787135839.196621:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616372480:0@lo:400: 00000100:00100000:2.0:1787135839.196649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135839.196741:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616372608 00000100:00100000:0.0:1787135839.196748:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616372608 00000100:00100000:0.0:1787135839.196804:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787135839.196813:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987482a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616372608:12345-0@lo:400: 00000100:00100000:0.0:1787135839.201994:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987482a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616372608:12345-0@lo:400: Request processed in 5173us (5415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135839.202007:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787135839.202018:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9881fc0e00 x1873947616372608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135839.202033:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616372608:0@lo:400: 00000100:00080000:0.0:1787135839.202037:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787135839.203139:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616372480 00000100:00100000:1.0:1787135839.203150:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616372480 00000100:00100000:1.0:1787135839.203269:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787135839.203279:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616372480:12345-0@lo:400: 00000100:00100000:1.0:1787135839.203345:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616372480:12345-0@lo:400: Request processed in 68us (6695us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135839.203351:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787135839.203392:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616372480:0@lo:400: 00000100:00080000:3.0:1787135839.203490:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787135839.320779:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787135839.572298:0:8427:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc64a6320 20000000:00000080:2.0:1787135839.572314:0:8427:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e9873c61800 uarg=0000000000000000 20000000:01000000:2.0:1787135839.572352:0:8427:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787135839.572354:0:8427:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787135839.572357:0:8427:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787135839.572367:0:8427:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787135839.572372:0:8427:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787135839.572385:0:8427:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787135839.572387:0:8427:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787135839.572559:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787135839.572562:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787135839.573646:0:8428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1787135839.574469:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1787135839.574518:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1787135839.574573:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1787135839.574588:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787135839.574591:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787135839.575695:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1787135839.585494:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1787135839.585574:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1787135839.585613:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1787135839.585631:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787135839.585633:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787135839.587173:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787135839.587607:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787135839.587657:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787135839.587691:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1787135839.587706:0:8427:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787135839.587708:0:8427:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787135839.589736:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1787135839.590466:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1787135839.590530:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1787135839.590568:0:8427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1787135839.590584:0:8427:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787135839.590604:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.590622:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841488400/0xf5850c552f2022b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2022ad expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.590631:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841489600/0xf5850c552f2022de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2022d7 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.590637:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98820e3400/0xf5850c552f202308 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202301 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.590644:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e987c2c7e00/0xf5850c552f202316 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20230f expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.590651:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98820e2200/0xf5850c552f202324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20231d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.590665:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98820e2400/0xf5850c552f202340 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202339 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.590672:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9840030a00/0xf5850c552f20236a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202363 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.590681:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841489c00/0xf5850c552f202378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180cc expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.590688:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841488600/0xf5850c552f20237f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180d3 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.590695:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.590732:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841488600/0xf5850c552f20237f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180d3 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.590747:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e9841488600/0xf5850c552f20237f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180d3 expref: 9 pid: 5815 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.590760:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616372992:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135839.591209:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841489c00/0xf5850c552f202378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180cc expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591220:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e9841489c00/0xf5850c552f202378 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180cc expref: 9 pid: 5815 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.591229:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616373120:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135839.591271:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9840030a00/0xf5850c552f20236a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f202363 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591279:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9840030a00/0xf5850c552f20236a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f202363 expref: 18 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.591289:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874979c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616373248:0@lo:104: 00000100:00100000:2.0:1787135839.591326:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787135839.591354:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98820e2400/0xf5850c552f202340 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f202339 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591361:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e98820e2400/0xf5850c552f202340 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f202339 expref: 18 pid: 5815 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.591369:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874979880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616373376:0@lo:104: 00000100:00100000:2.0:1787135839.591389:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135839.591432:0:5805:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787135839.591443:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616373248 00000100:00100000:2.0:1787135839.591449:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616373248 00000100:00100000:2.0:1787135839.591480:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616373376 00000100:00100000:2.0:1787135839.591482:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616373376 00000100:00100000:2.0:1787135839.591495:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787135839.591502:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+4:8427:x1873947616373248:12345-0@lo:104: 00010000:00010000:2.0:1787135839.591514:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20236a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591558:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135839.591564:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+4:8427:x1873947616373248:12345-0@lo:104: Request processed in 62us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135839.591581:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787135839.591596:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787135839.591602:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974511e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:8427:x1873947616373376:12345-0@lo:104: 00010000:00010000:2.0:1787135839.591610:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202340 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591641:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787135839.591646:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974511e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:8427:x1873947616373376:12345-0@lo:104: Request processed in 44us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135839.591651:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1787135839.591685:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787135839.591691:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20236a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591699:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840030400 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135839.591703:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f20236a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591711:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f20236a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135839.591717:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f20236a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135839.591723:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135839.591750:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20236a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591756:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135839.591779:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20236a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591798:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840030400/0xf5850c552f202363 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20236a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591811:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135839.591815:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202340 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591827:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840030c00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135839.591830:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202340 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591837:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202340 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135839.591843:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202340 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135839.591848:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135839.591860:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202340 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591866:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135839.591871:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202340 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591877:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f202339 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202340 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.591885:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.591891:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.591893:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135839.591905:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616373504:0@lo:103: 00000100:00100000:2.0:1787135839.591932:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135839.591953:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787135839.591958:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616373632:0@lo:103: 00000100:00100000:2.0:1787135839.591989:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135839.592012:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616373504 00000100:00100000:2.0:1787135839.592016:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616373504 00010000:00010000:2.0:1787135839.592031:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9840030a00/0xf5850c552f20236a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202363 expref: 19 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.592076:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616373632 00000100:00100000:2.0:1787135839.592079:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616373632 00010000:00010000:2.0:1787135839.592089:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98820e2400/0xf5850c552f202340 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202339 expref: 20 pid: 5815 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.592105:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787135839.592111:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e67bffa2-3749-4eab-9303-62ad12948de4+20:3300:x1873947616373504:12345-0@lo:103: 00010000:00010000:2.0:1787135839.592120:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135839.592133:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9840030a00/0xf5850c552f20236a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202363 expref: 20 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592143:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9840030a00/0xf5850c552f20236a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f202363 expref: 20 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592158:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135839.592186:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e67bffa2-3749-4eab-9303-62ad12948de4+20:3300:x1873947616373504:12345-0@lo:103: Request processed in 75us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135839.592191:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787135839.592212:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787135839.592217:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616373632:12345-0@lo:103: 00010000:00010000:2.0:1787135839.592224:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135839.592228:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98820e2400/0xf5850c552f202340 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202339 expref: 19 pid: 5815 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592235:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98820e2400/0xf5850c552f202340 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f202339 expref: 19 pid: 5815 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592244:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135839.592265:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616373632:12345-0@lo:103: Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135839.592270:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787135839.592304:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616373632:0@lo:103: 00000100:00100000:2.0:1787135839.592311:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616373504:0@lo:103: 00010000:00010000:2.0:1787135839.592339:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98820e2200/0xf5850c552f202324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f20231d expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592347:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e98820e2200/0xf5850c552f202324 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f20231d expref: 18 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.592354:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616373760:0@lo:104: 00000100:00100000:2.0:1787135839.592372:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135839.592392:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616373760 00000100:00100000:2.0:1787135839.592395:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616373760 00000100:00100000:2.0:1787135839.592410:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787135839.592415:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:8427:x1873947616373760:12345-0@lo:104: 00010000:00010000:2.0:1787135839.592422:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202324 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592455:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135839.592460:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:8427:x1873947616373760:12345-0@lo:104: Request processed in 44us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135839.592465:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1787135839.592478:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135839.592482:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202324 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592488:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841489400 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135839.592491:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202324 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592498:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202324 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135839.592504:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202324 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135839.592509:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135839.592523:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202324 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592529:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135839.592548:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202324 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592554:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f20231d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202324 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592574:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.592575:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.592577:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.592594:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e987c2c7e00/0xf5850c552f202316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f20230f expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592602:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e987c2c7e00/0xf5850c552f202316 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f20230f expref: 18 pid: 5813 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.592612:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616374016:0@lo:104: 00000100:00100000:2.0:1787135839.592632:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135839.592652:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616374016 00000100:00100000:2.0:1787135839.592655:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616374016 00000100:00100000:2.0:1787135839.592672:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787135839.592677:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:8427:x1873947616374016:12345-0@lo:104: 00010000:00010000:2.0:1787135839.592684:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202316 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592713:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135839.592718:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:8427:x1873947616374016:12345-0@lo:104: Request processed in 41us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135839.592723:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1787135839.592734:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135839.592738:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202316 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592743:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e3800 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135839.592747:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202316 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592758:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202316 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135839.592764:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202316 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135839.592769:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135839.592782:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202316 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592787:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135839.592792:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202316 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592797:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98820e3800/0xf5850c552f20230f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202316 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592807:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.592809:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.592810:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.592825:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98820e3400/0xf5850c552f202308 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f202301 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592833:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e98820e3400/0xf5850c552f202308 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f202301 expref: 18 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.592841:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616374272:0@lo:104: 00000100:00100000:2.0:1787135839.592862:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135839.592880:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616374272 00000100:00100000:2.0:1787135839.592889:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616374272 00000100:00100000:2.0:1787135839.592907:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787135839.592912:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:8427:x1873947616374272:12345-0@lo:104: 00010000:00010000:2.0:1787135839.592919:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202308 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592946:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135839.592951:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:8427:x1873947616374272:12345-0@lo:104: Request processed in 40us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135839.592956:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1787135839.592968:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135839.592972:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202308 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592978:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7600 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135839.592981:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202308 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.592989:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202308 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135839.592994:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202308 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135839.592999:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135839.593012:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202308 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593018:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135839.593026:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202308 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593037:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7600/0xf5850c552f202301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202308 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593065:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.593066:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.593068:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135839.593077:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616374400:0@lo:103: 00000100:00100000:2.0:1787135839.593100:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135839.593137:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616374400 00000100:00100000:2.0:1787135839.593140:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616374400 00010000:00010000:2.0:1787135839.593156:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98820e3400/0xf5850c552f202308 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202301 expref: 19 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.593173:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787135839.593179:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616374400:12345-0@lo:103: 00010000:00010000:2.0:1787135839.593186:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135839.593190:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98820e3400/0xf5850c552f202308 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202301 expref: 19 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593198:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98820e3400/0xf5850c552f202308 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f202301 expref: 19 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593208:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135839.593232:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616374400:12345-0@lo:103: Request processed in 53us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135839.593237:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787135839.593262:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616374400:0@lo:103: 00010000:00010000:2.0:1787135839.593294:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841489600/0xf5850c552f2022de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f2022d7 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593302:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9841489600/0xf5850c552f2022de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f2022d7 expref: 18 pid: 5813 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.593310:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616374528:0@lo:104: 00000100:00100000:2.0:1787135839.593335:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135839.593353:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616374528 00000100:00100000:2.0:1787135839.593356:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616374528 00000100:00100000:2.0:1787135839.593371:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787135839.593376:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:8427:x1873947616374528:12345-0@lo:104: 00010000:00010000:2.0:1787135839.593384:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2022de expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593413:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135839.593418:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:8427:x1873947616374528:12345-0@lo:104: Request processed in 42us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135839.593424:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1787135839.593436:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135839.593439:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2022de expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593446:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840031e00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135839.593449:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f2022de expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593457:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f2022de expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135839.593475:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f2022de expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135839.593480:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135839.593494:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2022de expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593500:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135839.593510:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2022de expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593517:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840031e00/0xf5850c552f2022d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2022de expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593526:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.593528:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.593529:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135839.593534:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787135839.593541:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616374656:0@lo:103: 00000100:00100000:2.0:1787135839.593576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135839.593600:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616374656 00000100:00100000:2.0:1787135839.593604:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616374656 00010000:00010000:2.0:1787135839.593617:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841489600/0xf5850c552f2022de lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2022d7 expref: 19 pid: 5813 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.593635:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787135839.593641:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616374656:12345-0@lo:103: 00010000:00010000:2.0:1787135839.593648:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135839.593652:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841489600/0xf5850c552f2022de lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2022d7 expref: 19 pid: 5813 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593666:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841489600/0xf5850c552f2022de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f2022d7 expref: 19 pid: 5813 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593676:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135839.593702:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616374656:12345-0@lo:103: Request processed in 61us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135839.593707:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787135839.593729:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616374656:0@lo:103: 00010000:00010000:2.0:1787135839.593755:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841488400/0xf5850c552f2022b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f2022ad expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593762:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9841488400/0xf5850c552f2022b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f2022ad expref: 18 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.593769:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616374784:0@lo:104: 00000100:00100000:2.0:1787135839.593788:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135839.593806:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616374784 00000100:00100000:2.0:1787135839.593809:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616374784 00000100:00100000:2.0:1787135839.593824:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787135839.593829:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:8427:x1873947616374784:12345-0@lo:104: 00010000:00010000:2.0:1787135839.593837:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2022b4 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593865:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135839.593870:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:8427:x1873947616374784:12345-0@lo:104: Request processed in 42us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135839.593876:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787135839.593896:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135839.593900:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2022b4 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593905:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7200 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135839.593908:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f2022b4 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593914:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f2022b4 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135839.593919:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f2022b4 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135839.593924:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787135839.593938:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2022b4 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593943:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135839.593947:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2022b4 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593953:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7200/0xf5850c552f2022ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2022b4 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.593964:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.593965:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135839.593966:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135839.593976:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98513d4480 going to sleep for 11 seconds 00010000:00010000:2.0:1787135839.593989:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9840030a00/0xf5850c552f20236a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f202363 expref: 18 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.594006:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874979c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616373248:0@lo:104: 00010000:00010000:2.0:1787135839.594015:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98820e2400/0xf5850c552f202340 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f202339 expref: 17 pid: 5815 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.594023:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874979880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616373376:0@lo:104: 00000100:00100000:2.0:1787135839.594030:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616373760:0@lo:104: 00000100:00100000:2.0:1787135839.594037:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616374016:0@lo:104: 00010000:00010000:2.0:1787135839.594044:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98820e3400/0xf5850c552f202308 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f202301 expref: 16 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.594074:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616374272:0@lo:104: 00010000:00010000:2.0:1787135839.594084:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841489600/0xf5850c552f2022de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f2022d7 expref: 15 pid: 5813 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135839.594092:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616374528:0@lo:104: 00000100:00100000:2.0:1787135839.594099:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616374784:0@lo:104: 00000100:00100000:1.0:1787135839.594807:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616373888:0@lo:103: 00000100:00100000:1.0:1787135839.594852:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135839.594892:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616374912:0@lo:103: 00000100:00100000:1.0:1787135839.594913:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135839.594933:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787135839.594938:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616374144:0@lo:103: 00000100:00100000:3.0:1787135839.595031:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616373888 00000100:00100000:3.0:1787135839.595037:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616373888 00010000:00010000:3.0:1787135839.595086:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98820e2200/0xf5850c552f202324 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20231d expref: 15 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135839.595137:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616374912 00000100:00100000:3.0:1787135839.595141:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616374912 00010000:00010000:3.0:1787135839.595154:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841488400/0xf5850c552f2022b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2022ad expref: 16 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135839.595167:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787135839.595174:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876caea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+16:3302:x1873947616373888:12345-0@lo:103: 00010000:00010000:3.0:1787135839.595184:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135839.595189:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98820e2200/0xf5850c552f202324 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20231d expref: 16 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.595197:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98820e2200/0xf5850c552f202324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f20231d expref: 16 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.595209:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98820e2200/0xf5850c552f202324 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f20231d expref: 16 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.595221:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135839.595263:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135839.595637:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876caea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+15:3302:x1873947616373888:12345-0@lo:103: Request processed in 462us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135839.595644:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787135839.595659:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616374144 00000100:00100000:3.0:1787135839.595663:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616374144 00010000:00010000:3.0:1787135839.595675:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e987c2c7e00/0xf5850c552f202316 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20230f expref: 15 pid: 5813 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135839.595688:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787135839.595694:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+15:3302:x1873947616374912:12345-0@lo:103: 00010000:00010000:3.0:1787135839.595709:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135839.595714:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841488400/0xf5850c552f2022b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2022ad expref: 15 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.595723:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841488400/0xf5850c552f2022b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f2022ad expref: 15 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.595733:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841488400/0xf5850c552f2022b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f2022ad expref: 15 pid: 5816 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.595741:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135839.595764:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+14:3302:x1873947616374912:12345-0@lo:103: Request processed in 71us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135839.595771:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787135839.595792:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787135839.595799:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+13:3302:x1873947616374144:12345-0@lo:103: 00010000:00010000:3.0:1787135839.595807:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135839.595811:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e987c2c7e00/0xf5850c552f202316 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20230f expref: 13 pid: 5813 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.595829:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e987c2c7e00/0xf5850c552f202316 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f20230f expref: 13 pid: 5813 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.595838:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e987c2c7e00/0xf5850c552f202316 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f20230f expref: 13 pid: 5813 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.595847:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135839.595868:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457c9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+12:3302:x1873947616374144:12345-0@lo:103: Request processed in 71us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135839.595874:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787135839.596204:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135839.598298:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616374144:0@lo:103: 00000100:00100000:1.0:1787135839.598315:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616373888:0@lo:103: 00000100:00100000:1.0:1787135839.598324:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616374912:0@lo:103: 00000100:00100000:2.0:1787135839.601452:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616372992:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135839.601479:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8427:1873947616373120:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135839.601525:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135839.603619:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135839.603660:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135839.603692:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595378816 00000100:00100000:3.0:1787135839.603701:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595378816 00010000:00010000:3.0:1787135839.603737:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841488600/0xf5850c552f20237f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180d3 expref: 10 pid: 5815 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135839.603931:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595378944 00000100:00100000:0.0:1787135839.603936:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595378944 00000100:00100000:3.0:1787135839.603939:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:3.0:1787135839.603949:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccb52158-7d35-4065-a26d-1bb142899404+11:2359:x1873947595378816:12345-192.168.203.38@tcp:103: 00010000:00010000:0.0:1787135839.603952:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841489c00/0xf5850c552f202378 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180cc expref: 11 pid: 5815 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135839.603979:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:0.0:1787135839.603986:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccb52158-7d35-4065-a26d-1bb142899404+11:2359:x1873947595378944:12345-192.168.203.38@tcp:103: 00010000:00010000:0.0:1787135839.603996:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135839.604001:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841489c00/0xf5850c552f202378 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180cc expref: 11 pid: 5815 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135839.604012:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841489c00/0xf5850c552f202378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180cc expref: 11 pid: 5815 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604026:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135839.604030:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841489c00/0xf5850c552f202378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180cc expref: 11 pid: 5815 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604031:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841488600/0xf5850c552f20237f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180d3 expref: 11 pid: 5815 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604041:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841488600/0xf5850c552f20237f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180d3 expref: 10 pid: 5815 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135839.604255:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787135839.604261:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841488600/0xf5850c552f20237f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180d3 expref: 10 pid: 5815 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604272:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604280:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604293:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604300:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604307:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135839.604308:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccb52158-7d35-4065-a26d-1bb142899404+9:2359:x1873947595378944:12345-192.168.203.38@tcp:103: Request processed in 322us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135839.604315:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00010000:00010000:3.0:1787135839.604323:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604328:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787135839.604333:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604342:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.604443:0:8427:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135839.604452:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604512:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604520:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e987c2c6000/0xf5850c552f2023b7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135839.604534:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135839.604566:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccb52158-7d35-4065-a26d-1bb142899404+8:2359:x1873947595378816:12345-192.168.203.38@tcp:103: Request processed in 618us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135839.604573:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:3.0:1787135839.704161:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616375040:0@lo:13: 00000100:00100000:3.0:1787135839.704227:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135839.704304:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616375040 00000100:00100000:3.0:1787135839.704311:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616375040 00000100:00100000:3.0:1787135839.704356:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787135839.704366:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616375040:12345-0@lo:13: 00002000:00000024:3.0:1787135839.704406:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135839.704745:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616375040:12345-0@lo:13: Request processed in 379us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135839.704759:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1787135839.704798:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9842aad880 x1873947616375040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135839.704815:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616375040:0@lo:13: 00000100:00100000:3.0:1787135839.704832:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787135839.704839:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616375168:0@lo:13: 00000100:00100000:3.0:1787135839.704863:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135839.704883:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616375168 00000100:00100000:3.0:1787135839.704886:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616375168 00000100:00100000:3.0:1787135839.704904:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787135839.704908:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616375168:12345-0@lo:13: 00002000:00000024:3.0:1787135839.704925:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135839.704958:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616375168:12345-0@lo:13: Request processed in 49us (93us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135839.704964:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1787135839.704993:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd1f80 x1873947616375168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135839.705004:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616375168:0@lo:13: 00000100:00100000:0.0:1787135840.294675:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135840.294815:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595379072 00000100:00100000:1.0:1787135840.294825:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595379072 00000100:00100000:1.0:1787135840.294885:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:1.0:1787135840.294906:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+8:5600:x1873947595379072:12345-192.168.203.38@tcp:101: 00010000:00010000:1.0:1787135840.294925:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135840.294945:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841488600/0xf5850c552f2023be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b718135 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135840.294973:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841488600/0xf5850c552f2023be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718135 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135840.294984:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841488600/0xf5850c552f2023be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718135 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135840.294993:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841488600, rc 0) 00000100:00100000:1.0:1787135840.295566:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+9:5600:x1873947595379072:12345-192.168.203.38@tcp:101: Request processed in 197us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135840.295577:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:1.0:1787135840.303927:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135840.304082:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595379200 00000100:00100000:0.0:1787135840.304100:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595379200 00000100:00100000:0.0:1787135840.304159:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:0.0:1787135840.304170:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+9:5600:x1873947595379200:12345-192.168.203.38@tcp:501: 00000100:00100000:0.0:1787135840.304863:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+9:5600:x1873947595379200:12345-192.168.203.38@tcp:501: Request processed in 692us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135840.304873:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:2.0:1787135840.307147:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135840.307294:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595379328 00000100:00100000:0.0:1787135840.307304:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595379328 00000100:00100000:0.0:1787135840.307360:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:0.0:1787135840.307370:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+9:5600:x1873947595379328:12345-192.168.203.38@tcp:503: 00000100:00100000:0.0:1787135840.308018:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+9:5600:x1873947595379328:12345-192.168.203.38@tcp:503: Request processed in 646us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135840.308028:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:0.0:1787135840.326039:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135840.327023:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595379456 00000100:00100000:2.0:1787135840.327035:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595379456 00000100:00100000:2.0:1787135840.327203:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:2.0:1787135840.327214:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+9:6067:x1873947595379456:12345-192.168.203.38@tcp:502: 00000100:00100000:2.0:1787135840.330209:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+9:6067:x1873947595379456:12345-192.168.203.38@tcp:502: Request processed in 2984us (4165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135840.330225:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:1.0:1787135840.341279:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135840.341470:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595379584 00000100:00100000:0.0:1787135840.341480:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595379584 00000100:00100000:0.0:1787135840.341536:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:0.0:1787135840.341547:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+9:6067:x1873947595379584:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787135840.342511:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+9:6067:x1873947595379584:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 960us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135840.342523:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 136 00010000:00010000:2.0:1787135840.345209:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135840.351427:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135840.351581:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595379712 00000100:00100000:2.0:1787135840.351592:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595379712 00000100:00100000:2.0:1787135840.351650:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:2.0:1787135840.351672:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+9:5600:x1873947595379712:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787135840.351689:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135840.351706:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e987c2c7600/0xf5850c552f2023c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b71813c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135840.351736:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e987c2c7600/0xf5850c552f2023c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71813c expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135840.351748:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e987c2c7600/0xf5850c552f2023c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71813c expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135840.351758:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7600, rc 0) 00000100:00100000:2.0:1787135840.351823:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:5600:x1873947595379712:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 154us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135840.351846:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:3.0:1787135840.355110:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135840.355293:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595379840 00000100:00100000:1.0:1787135840.355303:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595379840 00000100:00100000:1.0:1787135840.355367:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:1.0:1787135840.355377:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:5600:x1873947595379840:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135840.357208:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:5600:x1873947595379840:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 1822us (2105us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787135840.357239:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:1.0:1787135840.616933:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135840.616977:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135840.617019:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135840.617135:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595380096 00000100:00100000:3.0:1787135840.617146:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595380096 00000100:00100000:3.0:1787135840.617203:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595380224 00000100:00100000:3.0:1787135840.617206:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595380224 00000100:00100000:3.0:1787135840.617224:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:3.0:1787135840.617232:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595380096:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135840.617303:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595380096:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 70us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135840.617323:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:3.0:1787135840.617339:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:3.0:1787135840.617346:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595380224:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135840.617374:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595380224:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135840.617379:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00080000:3.0:1787135840.617394:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787135840.617398:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787135840.617665:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595379968 00000100:00100000:2.0:1787135840.617672:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595379968 00000100:00100000:2.0:1787135840.617712:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:2.0:1787135840.617720:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595379968:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135840.617758:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876caf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595379968:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 39us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135840.617764:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00080000:3.0:1787135840.619330:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1787135841.310917:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787135841.310924:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e9744a91800 from 39 10000000:01000000:2.0:1787135841.310928:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787135841.310967:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.310979:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.310990:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135841.311014:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616375296:0@lo:101: 00000100:00100000:2.0:1787135841.311101:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135841.311153:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98513d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135841.311950:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616375296 00000100:00100000:0.0:1787135841.311960:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616375296 00000100:00100000:0.0:1787135841.312008:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787135841.312027:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+12:5818:x1873947616375296:12345-0@lo:101: 00010000:00010000:0.0:1787135841.312041:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135841.312078:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9840031e00/0xf5850c552f2023d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2023cc expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.312102:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9840031e00/0xf5850c552f2023d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2023cc expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.312123:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9840031e00/0xf5850c552f2023d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2023cc expref: 13 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.312132:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9840031e00, rc 0) 00000100:00100000:0.0:1787135841.312183:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616375296:12345-0@lo:101: Request processed in 157us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.312189:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787135841.312584:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616375296:0@lo:101: 00010000:00010000:2.0:1787135841.312601:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.312621:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135841.312678:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616375424:0@lo:501: 00000100:00100000:2.0:1787135841.312707:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135841.312739:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98513d49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135841.313205:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616375424 00000100:00100000:0.0:1787135841.313211:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616375424 00000100:00100000:0.0:1787135841.313252:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787135841.313261:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616375424:12345-0@lo:501: 00000100:00100000:0.0:1787135841.313731:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616375424:12345-0@lo:501: Request processed in 470us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.313739:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787135841.314022:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616375424:0@lo:501: 00000100:00100000:3.0:1787135841.314096:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616375552:0@lo:503: 00000100:00100000:3.0:1787135841.314144:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.314167:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad840 going to sleep for 11 seconds 00000100:00100000:2.0:1787135841.314219:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616375552 00000100:00100000:2.0:1787135841.314224:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616375552 00000100:00100000:2.0:1787135841.314265:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787135841.314272:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616375552:12345-0@lo:503: 00000100:00100000:2.0:1787135841.314428:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616375552:12345-0@lo:503: Request processed in 156us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135841.314435:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787135841.314595:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616375552:0@lo:503: 00000100:00100000:3.0:1787135841.319573:0:8459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8459:1873947616375680:0@lo:502: 00000100:00100000:3.0:1787135841.319654:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.319701:0:8459:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1787135841.319819:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616375680 00000100:00100000:1.0:1787135841.319826:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616375680 00000100:00100000:1.0:1787135841.319876:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787135841.319885:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:8459:x1873947616375680:12345-0@lo:502: 00000100:00100000:1.0:1787135841.320173:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+13:8459:x1873947616375680:12345-0@lo:502: Request processed in 289us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135841.320182:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787135841.320579:0:8459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8459:1873947616375680:0@lo:502: 00000100:00100000:3.0:1787135841.320627:0:8459:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8459:1873947616375808:0@lo:502: 00000100:00100000:3.0:1787135841.320663:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.320694:0:8459:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad480 going to sleep for 11 seconds 00000100:00100000:0.0:1787135841.320735:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616375808 00000100:00100000:0.0:1787135841.320740:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616375808 00000100:00100000:0.0:1787135841.320773:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1787135841.320781:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:8459:x1873947616375808:12345-0@lo:502: 00000100:00100000:0.0:1787135841.320948:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+13:8459:x1873947616375808:12345-0@lo:502: Request processed in 167us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.320964:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787135841.321139:0:8459:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8459:1873947616375808:0@lo:502: 00000040:00080000:3.0:1787135841.321162:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787135841.328122:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787135841.328158:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787135841.328170:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.328182:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135841.328192:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787135841.328194:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787135841.328197:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787135841.328233:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.328356:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.328368:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135841.328392:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616375936:0@lo:101: 00000100:00100000:0.0:1787135841.328457:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135841.328506:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98533a6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.328621:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616375936 00000100:00100000:3.0:1787135841.328628:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616375936 00000100:00100000:3.0:1787135841.328676:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787135841.328684:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+13:5818:x1873947616375936:12345-0@lo:101: 00010000:00010000:3.0:1787135841.328696:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135841.328707:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511db000/0xf5850c552f2023e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2023da expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.328728:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511db000/0xf5850c552f2023e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2023da expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.328738:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511db000/0xf5850c552f2023e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2023da expref: 14 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.328747:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db000, rc 0) 00000100:00100000:3.0:1787135841.328789:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616375936:12345-0@lo:101: Request processed in 106us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.328796:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787135841.328850:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616375936:0@lo:101: 00010000:00010000:3.0:1787135841.328864:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.328872:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135841.328924:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616376064:0@lo:501: 00000100:00100000:3.0:1787135841.328946:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.328966:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad540 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.328977:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616376064 00000100:00100000:3.0:1787135841.328990:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616376064 00000100:00100000:3.0:1787135841.329012:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787135841.329018:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616376064:12345-0@lo:501: 00000100:00100000:3.0:1787135841.329300:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616376064:12345-0@lo:501: Request processed in 282us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.329307:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787135841.329345:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616376064:0@lo:501: 00000100:00100000:3.0:1787135841.329369:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616376192:0@lo:503: 00000100:00100000:3.0:1787135841.329405:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.329422:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad540 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.329433:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616376192 00000100:00100000:3.0:1787135841.329436:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616376192 00000100:00100000:3.0:1787135841.329452:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787135841.329615:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616376192:12345-0@lo:503: 00000100:00100000:3.0:1787135841.329778:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616376192:12345-0@lo:503: Request processed in 319us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.329784:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787135841.329883:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616376192:0@lo:503: 00000100:00100000:0.0:1787135841.330875:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8460:1873947616376320:0@lo:502: 00000100:00100000:0.0:1787135841.330923:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135841.330957:0:8460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843508d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.331070:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616376320 00000100:00100000:3.0:1787135841.331076:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616376320 00000100:00100000:3.0:1787135841.331110:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787135841.331127:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:8460:x1873947616376320:12345-0@lo:502: 00000100:00100000:3.0:1787135841.331306:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+14:8460:x1873947616376320:12345-0@lo:502: Request processed in 180us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.331314:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787135841.331558:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8460:1873947616376320:0@lo:502: 00000020:01000000:0.0:1787135841.331593:0:8460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787135841.331602:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135841.331604:0:8460:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787135841.331610:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787135841.331631:0:8460:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8460:1873947616376448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135841.331662:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135841.331690:0:8460:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843508d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.332395:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616376448 00000100:00100000:3.0:1787135841.332410:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616376448 00000100:00100000:3.0:1787135841.332445:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787135841.332452:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:8460:x1873947616376448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135841.334636:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+14:8460:x1873947616376448:12345-0@lo:502:llog_process_th.0 Request processed in 2177us (2965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.334650:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787135841.345307:0:8460:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8460:1873947616376448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787135841.345423:0:8460:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787135841.345435:0:8460:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787135841.345437:0:8460:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787135841.345441:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1787135841.345771:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1787135841.345794:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1787135841.345804:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.345826:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135841.345836:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787135841.345839:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e98735aa000 from 39 10000000:01000000:0.0:1787135841.345842:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787135841.345874:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.345882:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.345893:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135841.345913:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616376576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787135841.345986:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135841.346030:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843508d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.346179:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616376576 00000100:00100000:3.0:1787135841.346186:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616376576 00000100:00100000:3.0:1787135841.346226:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787135841.346234:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+14:5818:x1873947616376576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787135841.346247:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135841.346259:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511daa00/0xf5850c552f2023ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2023e8 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.346281:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511daa00/0xf5850c552f2023ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2023e8 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.346292:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511daa00/0xf5850c552f2023ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2023e8 expref: 15 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.346301:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511daa00, rc 0) 00000100:00100000:3.0:1787135841.346347:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616376576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.346354:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1787135841.346429:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616376576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787135841.346443:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.346451:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135841.346508:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616376704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135841.346534:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135841.346561:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9741084cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.346658:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616376704 00000100:00100000:3.0:1787135841.346668:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616376704 00000100:00100000:3.0:1787135841.346697:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787135841.346703:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616376704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.346942:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616376704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.346949:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787135841.346977:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616376704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.347004:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616376832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.347039:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.347080:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad780 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.347092:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616376832 00000100:00100000:3.0:1787135841.347096:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616376832 00000100:00100000:3.0:1787135841.347125:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787135841.347131:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616376832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.347263:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616376832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.347270:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787135841.347301:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616376832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787135841.353367:0:8461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8461:1873947616376960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135841.353444:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135841.353494:0:8461:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843508480 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.353604:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616376960 00000100:00100000:3.0:1787135841.353610:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616376960 00000100:00100000:3.0:1787135841.353658:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787135841.353668:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:8461:x1873947616376960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135841.353928:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+15:8461:x1873947616376960:12345-0@lo:502:llog_process_th.0 Request processed in 261us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.353936:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787135841.354268:0:8461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8461:1873947616376960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787135841.354321:0:8461:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8461:1873947616377088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787135841.354356:0:8461:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135841.354374:0:8461:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98513d4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.354646:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616377088 00000100:00100000:3.0:1787135841.354652:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616377088 00000100:00100000:3.0:1787135841.354684:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787135841.354692:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+15:8461:x1873947616377088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135841.354853:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+15:8461:x1873947616377088:12345-0@lo:502:llog_process_th.0 Request processed in 161us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.354859:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787135841.356110:0:8461:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8461:1873947616377088:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787135841.356159:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787135841.356341:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787135841.356361:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787135841.356372:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.356383:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787135841.356392:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787135841.356394:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1787135841.356398:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787135841.356426:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.356434:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.356442:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135841.356559:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616377216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.356603:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.356645:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135841.356691:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616377216 00000100:00100000:0.0:1787135841.356698:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616377216 00000100:00100000:0.0:1787135841.356736:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787135841.356743:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+15:5818:x1873947616377216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787135841.356754:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135841.356765:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9840030400/0xf5850c552f2023fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2023f6 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.356785:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9840030400/0xf5850c552f2023fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2023f6 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.356796:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9840030400/0xf5850c552f2023fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2023f6 expref: 16 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.356803:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9840030400, rc 0) 00000100:00100000:0.0:1787135841.356847:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616377216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.356853:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787135841.357038:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616377216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787135841.357087:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.357096:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135841.357150:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616377344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.357172:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.357189:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135841.358689:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616377344 00000100:00100000:0.0:1787135841.358700:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616377344 00000100:00100000:0.0:1787135841.358747:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787135841.358755:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616377344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787135841.359037:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616377344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.359077:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787135841.359192:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616377344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135841.359239:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616377472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787135841.359283:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135841.359309:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98513d4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.359725:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616377472 00000100:00100000:3.0:1787135841.359731:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616377472 00000100:00100000:3.0:1787135841.359760:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787135841.359768:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616377472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.359950:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616377472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.359957:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787135841.361007:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616377472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.361630:0:8463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8463:1873947616377600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135841.361687:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.361730:0:8463:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1787135841.361827:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616377600 00000100:00100000:0.0:1787135841.361833:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616377600 00000100:00100000:0.0:1787135841.361873:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1787135841.361888:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:8463:x1873947616377600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135841.362100:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:8463:x1873947616377600:12345-0@lo:502:llog_process_th.0 Request processed in 212us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.362107:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787135841.362286:0:8463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8463:1873947616377600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787135841.362311:0:8463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787135841.362319:0:8463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787135841.362321:0:8463:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787135841.362332:0:8463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787135841.362355:0:8463:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8463:1873947616377728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135841.362388:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.362405:0:8463:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1787135841.363924:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616377728 00000100:00100000:0.0:1787135841.363937:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616377728 00000100:00100000:0.0:1787135841.363987:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1787135841.363997:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+16:8463:x1873947616377728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135841.364373:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+16:8463:x1873947616377728:12345-0@lo:502:llog_process_th.0 Request processed in 378us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.364380:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787135841.365747:0:8463:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8463:1873947616377728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787135841.365783:0:8463:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787135841.365792:0:8463:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787135841.365794:0:8463:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787135841.365798:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00010000:00010000:2.0:1787135841.368558:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787135841.376133:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1787135841.376173:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787135841.376185:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.376209:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787135841.376220:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787135841.376223:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e98456a5800 from 39 10000000:01000000:1.0:1787135841.376226:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787135841.376417:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.376426:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.376437:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135841.376536:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616377856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787135841.376604:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135841.376647:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e97410846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.376870:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616377856 00000100:00100000:3.0:1787135841.376879:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616377856 00000100:00100000:3.0:1787135841.376931:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787135841.376940:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616377856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787135841.376955:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135841.376968:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511dae00/0xf5850c552f20240b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202404 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.377002:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511dae00/0xf5850c552f20240b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202404 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.377012:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511dae00/0xf5850c552f20240b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202404 expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.377021:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dae00, rc 0) 00000100:00100000:3.0:1787135841.377086:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616377856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.377092:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1787135841.377590:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616377856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787135841.377606:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.377616:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135841.377672:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616377984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135841.377701:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135841.377742:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e97410846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.377934:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616377984 00000100:00100000:3.0:1787135841.377940:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616377984 00000100:00100000:3.0:1787135841.377992:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787135841.378000:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616377984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.378626:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616377984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 626us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.378634:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787135841.379409:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616377984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135841.379453:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616378112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787135841.379567:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135841.379607:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e97410846c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.379897:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616378112 00000100:00100000:3.0:1787135841.379904:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616378112 00000100:00100000:3.0:1787135841.379963:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787135841.379971:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616378112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.380315:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616378112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 344us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.380322:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787135841.380367:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616378112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.382161:0:8465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8465:1873947616378240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135841.382235:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.382268:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616378240 00000100:00100000:3.0:1787135841.382273:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616378240 00000100:00100000:3.0:1787135841.382315:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787135841.382323:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+17:8465:x1873947616378240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135841.382640:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+17:8465:x1873947616378240:12345-0@lo:502:llog_process_th.0 Request processed in 317us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.382648:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787135841.382691:0:8465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ade40 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.382709:0:8465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8465:1873947616378240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135841.382749:0:8465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8465:1873947616378368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135841.382780:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.382801:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616378368 00000100:00100000:3.0:1787135841.382805:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616378368 00000100:00100000:3.0:1787135841.385125:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787135841.385142:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:8465:x1873947616378368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135841.385390:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:8465:x1873947616378368:12345-0@lo:502:llog_process_th.0 Request processed in 254us (2607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.385398:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787135841.398130:0:8465:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ade40 going to sleep for 11 seconds 00000100:00100000:2.0:1787135841.398178:0:8465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8465:1873947616378368:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787135841.398234:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787135841.399576:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787135841.399603:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787135841.399614:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.399626:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135841.399635:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1787135841.399638:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1787135841.399641:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787135841.399674:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.399687:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.399697:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135841.399719:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616378496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787135841.399863:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135841.400553:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843508d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.404248:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616378496 00000100:00100000:3.0:1787135841.404263:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616378496 00000100:00100000:3.0:1787135841.404323:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787135841.404334:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616378496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787135841.404352:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135841.404371:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511dbc00/0xf5850c552f202419 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202412 expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.404399:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511dbc00/0xf5850c552f202419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202412 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.404411:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511dbc00/0xf5850c552f202419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202412 expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.404428:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dbc00, rc 0) 00000100:00100000:3.0:1787135841.404499:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616378496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 167us (4643us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.404506:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787135841.404557:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616378496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787135841.404582:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.404592:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135841.404655:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616378624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.404686:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.404721:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607add80 going to sleep for 11 seconds 00000100:00100000:0.0:1787135841.404864:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616378624 00000100:00100000:0.0:1787135841.404869:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616378624 00000100:00100000:0.0:1787135841.404907:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1787135841.404913:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616378624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787135841.405183:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616378624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.405190:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787135841.405865:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616378624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.405904:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616378752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.405947:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.405973:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607add80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.405998:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616378752 00000100:00100000:3.0:1787135841.406002:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616378752 00000100:00100000:3.0:1787135841.406030:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787135841.406037:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616378752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.406233:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616378752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.406239:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787135841.406282:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616378752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787135841.406715:0:8467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8467:1873947616378880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135841.406747:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.406778:0:8467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9851155600 going to sleep for 11 seconds 00000100:00100000:0.0:1787135841.407110:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616378880 00000100:00100000:0.0:1787135841.407126:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616378880 00000100:00100000:0.0:1787135841.407175:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1787135841.407182:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:8467:x1873947616378880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135841.407572:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:8467:x1873947616378880:12345-0@lo:502:llog_process_th.0 Request processed in 390us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.407580:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787135841.407664:0:8467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8467:1873947616378880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787135841.407694:0:8467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787135841.407704:0:8467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787135841.407706:0:8467:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787135841.407711:0:8467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787135841.407734:0:8467:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8467:1873947616379008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135841.407767:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135841.407798:0:8467:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9851155600 going to sleep for 11 seconds 00000100:00100000:0.0:1787135841.407926:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616379008 00000100:00100000:0.0:1787135841.407931:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616379008 00000100:00100000:0.0:1787135841.407960:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1787135841.407974:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:8467:x1873947616379008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135841.408267:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:8467:x1873947616379008:12345-0@lo:502:llog_process_th.0 Request processed in 293us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.408275:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1787135841.408351:0:8467:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8467:1873947616379008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787135841.408369:0:8467:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787135841.408374:0:8467:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787135841.408376:0:8467:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787135841.408379:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1787135841.408572:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1787135841.408591:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787135841.408600:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.408611:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135841.408620:0:5818:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787135841.408622:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8e9860760000 from 1 10000000:01000000:0.0:1787135841.408625:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787135841.408646:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031600/0xf5850c552f202420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.408653:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9840031600/0xf5850c552f202420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.408663:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9840031600/0xf5850c552f202420 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135841.408675:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616379136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787135841.408700:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135841.408726:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98749eac00 going to sleep for 11 seconds 00000100:00100000:3.0:1787135841.408759:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616379136 00000100:00100000:3.0:1787135841.408762:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616379136 00000100:00100000:3.0:1787135841.408788:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1787135841.408794:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616379136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787135841.408803:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135841.409311:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511db200/0xf5850c552f202427 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202420 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.409332:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511db200/0xf5850c552f202427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202420 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.409342:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511db200/0xf5850c552f202427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202420 expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.409351:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db200, rc 0) 00000100:00100000:3.0:1787135841.409386:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616379136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 592us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.409400:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787135841.409506:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616379136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787135841.409528:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9840031600/0xf5850c552f202420 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202427 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.409536:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9840031600/0xf5850c552f202420 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202427 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135841.409581:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616379264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787135841.409605:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135841.409621:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98749eac00 going to sleep for 11 seconds 00000100:00100000:0.0:1787135841.409634:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616379264 00000100:00100000:0.0:1787135841.409637:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616379264 00000100:00100000:0.0:1787135841.409660:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787135841.409666:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616379264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135841.411559:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616379264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1887us (1946us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787135841.411572:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1787135841.411663:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616379264:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1787135841.411697:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1787135841.411705:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031600/0xf5850c552f202420 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202427 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.411715:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9840031600/0xf5850c552f202420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202427 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1787135841.676692:0:8486:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe4ea8360 20000000:00000080:2.0:1787135841.676707:0:8486:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e9852a97400 uarg=0000000000000000 20000000:01000000:3.0:1787135841.677853:0:8486:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787135841.677860:0:8486:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787135841.677864:0:8486:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787135841.678720:0:8487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1787135841.678860:0:8486:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787135841.683788:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787135841.683925:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787135841.683970:0:8486:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787135841.683985:0:8486:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787135841.684001:0:8486:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.684017:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9840030200/0xf5850c552f2021a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20219c expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.684024:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98820e3a00/0xf5850c552f202205 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2021fe expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.684029:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841488a00/0xf5850c552f2022d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2022c9 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.684037:0:8486:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841489200/0xf5850c552f20238d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718104 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.684043:0:8486:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.684212:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841489200/0xf5850c552f20238d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718104 expref: 9 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.684225:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e9841489200/0xf5850c552f20238d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718104 expref: 9 pid: 5816 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135841.684246:0:8486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1873947616379392:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787135841.684375:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841488a00/0xf5850c552f2022d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f2022c9 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.684383:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9841488a00/0xf5850c552f2022d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f2022c9 expref: 18 pid: 5815 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135841.684391:0:8486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1873947616379520:0@lo:104: 00000100:00100000:1.0:1787135841.684424:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787135841.684459:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98820e3a00/0xf5850c552f202205 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f2021fe expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.684466:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e98820e3a00/0xf5850c552f202205 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f2021fe expref: 18 pid: 5813 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135841.684473:0:8486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1873947616379648:0@lo:104: 00000100:00100000:1.0:1787135841.684489:0:8486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787135841.684510:0:8486:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9840030200/0xf5850c552f2021a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f20219c expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.684517:0:8486:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9840030200/0xf5850c552f2021a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f20219c expref: 18 pid: 5813 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135841.684524:0:8486:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1873947616379776:0@lo:104: 00000100:00100000:1.0:1787135841.684538:0:8486:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787135841.684615:0:5804:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787135841.684632:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135841.684641:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616379520 00000100:00100000:0.0:1787135841.684646:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616379520 00000100:00100000:0.0:1787135841.684674:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616379648 00000100:00100000:0.0:1787135841.684676:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616379648 00000100:00100000:0.0:1787135841.684689:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616379776 00000100:00100000:0.0:1787135841.684692:0:5804:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616379776 00000100:00100000:0.0:1787135841.684701:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787135841.684708:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+5:8486:x1873947616379520:12345-0@lo:104: 00010000:00010000:0.0:1787135841.684719:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2022d0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.684768:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787135841.684773:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+5:8486:x1873947616379520:12345-0@lo:104: Request processed in 66us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.684779:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787135841.684792:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787135841.684797:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+4:8486:x1873947616379648:12345-0@lo:104: 00010000:00010000:0.0:1787135841.684811:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202205 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.684836:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787135841.684840:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+4:8486:x1873947616379648:12345-0@lo:104: Request processed in 43us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.684845:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787135841.684870:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787135841.684875:0:5804:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+3:8486:x1873947616379776:12345-0@lo:104: 00010000:00010000:0.0:1787135841.684881:0:5804:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98413cb200/0xf5850c552f20219c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2021a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135841.684902:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787135841.684906:0:5804:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e67bffa2-3749-4eab-9303-62ad12948de4+3:8486:x1873947616379776:12345-0@lo:104: Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135841.684919:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787135841.685033:0:8486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1873947616379520:0@lo:104: 00000100:00100000:1.0:1787135841.685064:0:8486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1873947616379648:0@lo:104: 00000100:00100000:1.0:1787135841.685081:0:8486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1873947616379776:0@lo:104: 00010000:00010000:2.0:1787135841.685102:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787135841.685120:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2022d0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685131:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6c00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135841.685136:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f2022d0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685145:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f2022d0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135841.685553:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f2022d0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135841.685559:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787135841.685596:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2022d0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685603:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135841.685632:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2022d0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685650:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6c00/0xf5850c552f2022c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2022d0 expref: -99 pid: 7606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685664:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787135841.685668:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202205 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685674:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cae00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135841.685677:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202205 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685684:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202205 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135841.685690:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202205 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135841.685695:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787135841.685711:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202205 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685716:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135841.685731:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202205 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685739:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2021fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202205 expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685749:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135841.685758:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98413cb200/0xf5850c552f20219c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2021a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685764:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cb200 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135841.685767:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cb200/0xf5850c552f20219c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f2021a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685774:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98413cb200/0xf5850c552f20219c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f2021a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135841.685780:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cb200/0xf5850c552f20219c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f2021a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135841.685785:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787135841.685797:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98413cb200/0xf5850c552f20219c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2021a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685803:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135841.685809:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98413cb200/0xf5850c552f20219c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2021a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685815:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98413cb200/0xf5850c552f20219c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2021a3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.685949:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135841.685952:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135841.685955:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135841.685956:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616379904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787135841.685965:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135841.685984:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616380032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787135841.685994:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135841.686405:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135841.686443:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787135841.686459:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616380160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787135841.686461:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616379904 00000100:00100000:1.0:1787135841.686468:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616379904 00000100:00100000:2.0:1787135841.686487:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787135841.686497:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841488a00/0xf5850c552f2022d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2022c9 expref: 19 pid: 5815 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135841.686531:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616380032 00000100:00100000:1.0:1787135841.686534:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616380032 00000100:00100000:2.0:1787135841.686538:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616380160 00000100:00100000:2.0:1787135841.686544:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616380160 00010000:00010000:1.0:1787135841.686547:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98820e3a00/0xf5850c552f202205 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2021fe expref: 20 pid: 5813 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.686564:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9840030200/0xf5850c552f2021a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20219c expref: 21 pid: 5813 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135841.686565:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787135841.686577:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+21:3301:x1873947616379904:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787135841.686588:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1787135841.686589:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135841.686597:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841488a00/0xf5850c552f2022d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2022c9 expref: 21 pid: 5815 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135841.686600:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e67bffa2-3749-4eab-9303-62ad12948de4+21:3302:x1873947616380032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787135841.686614:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135841.686615:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841488a00/0xf5850c552f2022d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f2022c9 expref: 21 pid: 5815 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.686622:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98820e3a00/0xf5850c552f202205 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2021fe expref: 21 pid: 5813 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.686634:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841488a00/0xf5850c552f2022d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f2022c9 expref: 21 pid: 5815 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.686635:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98820e3a00/0xf5850c552f202205 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f2021fe expref: 21 pid: 5813 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135841.686659:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98820e3a00/0xf5850c552f202205 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f2021fe expref: 20 pid: 5813 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.686660:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135841.686674:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135841.686699:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616379904:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135841.686707:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787135841.686715:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616380032:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135841.686724:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787135841.686734:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787135841.686741:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+17:3302:x1873947616380160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787135841.686751:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135841.686756:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9840030200/0xf5850c552f2021a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20219c expref: 17 pid: 5813 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135841.686761:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616380032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787135841.686768:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9840030200/0xf5850c552f2021a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f20219c expref: 17 pid: 5813 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.686780:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9840030200/0xf5850c552f2021a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f20219c expref: 17 pid: 5813 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.686789:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135841.686825:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+16:3302:x1873947616380160:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135841.686831:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787135841.686854:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616379904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787135841.687331:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616380160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787135841.688292:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135841.689193:0:8486:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8486:1873947616379392:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787135841.689233:0:8486:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135841.689506:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595380352 00000100:00100000:3.0:1787135841.689514:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595380352 00010000:00010000:3.0:1787135841.689548:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841489200/0xf5850c552f20238d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718104 expref: 10 pid: 5816 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135841.689581:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1787135841.689590:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccb52158-7d35-4065-a26d-1bb142899404+10:2360:x1873947595380352:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787135841.689603:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135841.689608:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841489200/0xf5850c552f20238d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718104 expref: 10 pid: 5816 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.689620:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841489200/0xf5850c552f20238d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718104 expref: 10 pid: 5816 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.689637:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841489200/0xf5850c552f20238d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718104 expref: 10 pid: 5816 timeout: 301 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.689653:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.689662:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.689675:0:7612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.689693:0:7612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.689699:0:7612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.689705:0:7612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.689710:0:7612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841489000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787135841.689714:0:7612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.689721:0:7612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.689740:0:7612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135841.689749:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135841.689814:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccb52158-7d35-4065-a26d-1bb142899404+9:2360:x1873947595380352:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 224us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135841.689821:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00010000:00010000:1.0:1787135841.692190:0:8486:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.692206:0:8486:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135841.692214:0:8486:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841489000/0xf5850c552f20242e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135842.126615:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135842.126849:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595380480 00000100:00100000:1.0:1787135842.126859:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595380480 00000100:00100000:1.0:1787135842.126915:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 171 00000100:00100000:1.0:1787135842.126926:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+9:5600:x1873947595380480:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787135842.126943:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135842.126961:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841489000/0xf5850c552f202435 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b718143 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135842.126988:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841489000/0xf5850c552f202435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718143 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135842.127000:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841489000/0xf5850c552f202435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718143 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135842.127009:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841489000, rc 0) 00000100:00100000:1.0:1787135842.127114:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:5600:x1873947595380480:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 182us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135842.127123:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 171 00000100:00100000:0.0:1787135842.138377:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135842.138523:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595380608 00000100:00100000:2.0:1787135842.138532:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595380608 00000100:00100000:2.0:1787135842.138598:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:2.0:1787135842.138607:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:5600:x1873947595380608:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135842.138903:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:5600:x1873947595380608:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 296us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135842.138915:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:3.0:1787135842.146303:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135842.146400:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595380736 00000100:00100000:2.0:1787135842.146421:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595380736 00000100:00100000:2.0:1787135842.146479:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 173 00000100:00100000:2.0:1787135842.146489:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:5600:x1873947595380736:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787135842.146823:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:5600:x1873947595380736:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 335us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135842.146831:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 173 00000100:00100000:3.0:1787135842.152651:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135842.152780:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595380864 00000100:00100000:1.0:1787135842.152791:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595380864 00000100:00100000:1.0:1787135842.152856:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 174 00000100:00100000:1.0:1787135842.152867:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:6119:x1873947595380864:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787135842.153134:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:6119:x1873947595380864:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 268us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135842.153143:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 174 00000100:00100000:1.0:1787135842.169843:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135842.169984:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595380992 00000100:00100000:0.0:1787135842.169994:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595380992 00000100:00100000:0.0:1787135842.170044:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 175 00000100:00100000:0.0:1787135842.170083:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:6119:x1873947595380992:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787135842.172783:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:6119:x1873947595380992:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 2692us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135842.172797:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 175 00010000:00010000:1.0:1787135842.394033:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135843.421897:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787135843.737899:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787135843.737907:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e9744a91800 from 4 10000000:01000000:0.0:1787135843.737912:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787135843.737955:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135843.737968:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135843.737980:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135843.738006:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616380288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787135843.738104:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135843.738150:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9741084480 going to sleep for 11 seconds 00000100:00100000:2.0:1787135843.738214:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616380288 00000100:00100000:2.0:1787135843.738223:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616380288 00000100:00100000:3.0:1787135843.738795:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1787135843.738805:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616380288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787135843.738829:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135843.738843:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511dac00/0xf5850c552f202443 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20243c expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135843.738868:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511dac00/0xf5850c552f202443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20243c expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135843.738877:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511dac00/0xf5850c552f202443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20243c expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135843.738886:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dac00, rc 0) 00000100:00100000:3.0:1787135843.738941:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616380288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135843.738947:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787135843.739042:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616380288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787135843.739089:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202443 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135843.739110:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202443 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135843.739172:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616380416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135843.739202:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135843.739232:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486000 going to sleep for 11 seconds 00000100:00100000:0.0:1787135843.739662:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616380416 00000100:00100000:0.0:1787135843.739675:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616380416 00000100:00100000:0.0:1787135843.739710:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787135843.739718:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616380416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787135843.739973:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616380416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135843.739982:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787135843.740032:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616380416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787135843.740079:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616380544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787135843.740130:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135843.740152:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9741084540 going to sleep for 11 seconds 00000100:00100000:0.0:1787135843.740162:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616380544 00000100:00100000:0.0:1787135843.740165:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616380544 00000100:00100000:0.0:1787135843.740182:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787135843.740188:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616380544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787135843.740313:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616380544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135843.740321:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787135843.740353:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616380544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787135843.740555:0:8562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8562:1873947616380672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135843.740587:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135843.740606:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616380672 00000100:00100000:0.0:1787135843.741502:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616380672 00000100:00100000:0.0:1787135843.741600:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787135843.741609:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:8562:x1873947616380672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135843.741820:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:8562:x1873947616380672:12345-0@lo:502:llog_process_th.0 Request processed in 211us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135843.741828:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787135843.741887:0:8562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e97410846c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135843.741910:0:8562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8562:1873947616380672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787135843.741939:0:8562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787135843.741949:0:8562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135843.741952:0:8562:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787135843.741957:0:8562:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e9744a91800 00000020:00000080:0.0:1787135843.741960:0:8562:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787135843.743174:0:8562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8562:1873947616380800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787135843.743227:0:8562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135843.743267:0:8562:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874107840 going to sleep for 11 seconds 00000100:00100000:2.0:1787135843.743276:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616380800 00000100:00100000:2.0:1787135843.743290:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616380800 00000100:00100000:2.0:1787135843.743341:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787135843.743351:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:8562:x1873947616380800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787135843.743556:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:8562:x1873947616380800:12345-0@lo:502:llog_process_th.0 Request processed in 207us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135843.743564:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787135843.743680:0:8562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8562:1873947616380800:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787135843.743712:0:8562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787135843.743722:0:8562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787135843.743724:0:8562:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787135843.743732:0:8562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1787135843.744370:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1787135843.744399:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787135843.744408:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202443 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135843.744420:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202443 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135843.744431:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787135843.744434:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e98735aa000 from 4 10000000:01000000:2.0:1787135843.744437:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787135843.744466:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135843.744475:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135843.744484:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135843.744502:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616380928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787135843.744542:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135843.744872:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486180 going to sleep for 11 seconds 00000100:00100000:1.0:1787135843.744928:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616380928 00000100:00100000:1.0:1787135843.744935:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616380928 00000100:00100000:1.0:1787135843.744977:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787135843.744986:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616380928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787135843.744998:0:5816:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135843.745010:0:5816:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841489c00/0xf5850c552f202451 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20244a expref: -99 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135843.745031:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841489c00/0xf5850c552f202451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20244a expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135843.745042:0:5816:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841489c00/0xf5850c552f202451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20244a expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135843.745073:0:5816:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841489c00, rc 0) 00000100:00100000:1.0:1787135843.745120:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616380928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135843.745127:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1787135843.745209:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616380928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787135843.745231:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202451 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135843.745241:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202451 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135843.745289:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616381056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135843.745318:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135843.745340:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486180 going to sleep for 11 seconds 00000100:00100000:2.0:1787135843.745352:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616381056 00000100:00100000:2.0:1787135843.745356:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616381056 00000100:00100000:2.0:1787135843.745382:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787135843.745389:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616381056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135843.745630:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616381056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135843.745637:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787135843.745670:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616381056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135843.745697:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616381184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787135843.745733:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135843.745747:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486180 going to sleep for 11 seconds 00000100:00100000:2.0:1787135843.745758:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616381184 00000100:00100000:2.0:1787135843.745762:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616381184 00000100:00100000:2.0:1787135843.745799:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787135843.745805:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616381184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787135843.745954:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616381184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135843.745970:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787135843.746005:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616381184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787135843.746220:0:8565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8565:1873947616381312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787135843.746256:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135843.746277:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616381312 00000100:00100000:2.0:1787135843.746281:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616381312 00000100:00100000:2.0:1787135843.746301:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787135843.746308:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:8565:x1873947616381312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787135843.746446:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:8565:x1873947616381312:12345-0@lo:502:llog_process_th.0 Request processed in 137us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135843.746453:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1787135843.746487:0:8565:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486240 going to sleep for 11 seconds 00000100:00100000:2.0:1787135843.746499:0:8565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8565:1873947616381312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787135843.746519:0:8565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787135843.746526:0:8565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787135843.746529:0:8565:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787135843.746534:0:8565:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e98735aa000 00000020:00000080:2.0:1787135843.746537:0:8565:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787135843.746989:0:8565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8565:1873947616381440:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787135843.747029:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135843.747410:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616381440 00000100:00100000:2.0:1787135843.747416:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616381440 00000100:00100000:2.0:1787135843.747486:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787135843.747494:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:8565:x1873947616381440:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787135843.747720:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:8565:x1873947616381440:12345-0@lo:502:llog_process_th.0 Request processed in 226us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135843.747734:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1787135843.747879:0:8565:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486240 going to sleep for 11 seconds 00000100:00100000:2.0:1787135843.747900:0:8565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8565:1873947616381440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787135843.747925:0:8565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787135843.747933:0:8565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787135843.747935:0:8565:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787135843.747938:0:8565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787135843.748182:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787135843.748216:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787135843.748226:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202451 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135843.748236:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202451 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787135843.748245:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787135843.748248:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e98456a5800 from 4 10000000:01000000:1.0:1787135843.748250:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787135843.748276:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135843.748284:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135843.748293:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135843.748309:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616381568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787135843.748347:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135843.748412:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874107540 going to sleep for 11 seconds 00000100:00100000:2.0:1787135843.748446:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616381568 00000100:00100000:2.0:1787135843.748450:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616381568 00000100:00100000:2.0:1787135843.748512:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787135843.748519:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616381568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787135843.748528:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135843.748539:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e987c2c7400/0xf5850c552f20245f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202458 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135843.748560:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e987c2c7400/0xf5850c552f20245f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202458 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135843.748569:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e987c2c7400/0xf5850c552f20245f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202458 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135843.748647:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7400, rc 0) 00000100:00100000:2.0:1787135843.748692:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616381568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135843.748698:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787135843.748757:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616381568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787135843.748782:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20245f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135843.748792:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20245f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135843.748840:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616381696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787135843.748871:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135843.749462:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457db600 going to sleep for 11 seconds 00000100:00100000:1.0:1787135843.749586:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616381696 00000100:00100000:1.0:1787135843.749592:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616381696 00000100:00100000:1.0:1787135843.749621:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787135843.749629:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616381696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135843.750091:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616381696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 461us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135843.750111:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787135843.750162:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616381696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135843.750201:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616381824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787135843.750235:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135843.750253:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874107240 going to sleep for 11 seconds 00000100:00100000:1.0:1787135843.750263:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616381824 00000100:00100000:1.0:1787135843.750266:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616381824 00000100:00100000:1.0:1787135843.750281:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787135843.750286:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616381824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787135843.750407:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616381824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135843.750414:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787135843.750449:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616381824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787135843.753091:0:8567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8567:1873947616381952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787135843.753176:0:8567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135843.753216:0:8567:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98741076c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135843.753220:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616381952 00000100:00100000:3.0:1787135843.753228:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616381952 00000100:00100000:3.0:1787135843.753284:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787135843.753294:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:8567:x1873947616381952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787135843.753518:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:8567:x1873947616381952:12345-0@lo:502:llog_process_th.0 Request processed in 226us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135843.753527:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787135843.753748:0:8567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8567:1873947616381952:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787135843.753770:0:8567:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787135843.753779:0:8567:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135843.753782:0:8567:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787135843.753788:0:8567:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e98456a5800 00000020:00000080:0.0:1787135843.753790:0:8567:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787135843.753856:0:8567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8567:1873947616382080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135843.753884:0:8567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135843.753897:0:8567:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457db0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135843.753910:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616382080 00000100:00100000:0.0:1787135843.753913:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616382080 00000100:00100000:0.0:1787135843.753950:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787135843.753956:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:8567:x1873947616382080:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135843.754140:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:8567:x1873947616382080:12345-0@lo:502:llog_process_th.0 Request processed in 184us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135843.754147:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787135843.754186:0:8567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc2680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:8567:1873947616382080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787135843.754205:0:8567:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787135843.754209:0:8567:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135843.754211:0:8567:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787135843.754214:0:8567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1787135843.754380:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1787135843.754406:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787135843.754416:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20245f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135843.754427:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20245f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135844.314921:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616382592:0@lo:400:kworker.0 00000100:00100000:3.0:1787135844.314947:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616382464:0@lo:400:kworker.0 00000100:00100000:2.0:1787135844.314990:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135844.315002:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135844.315071:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616382208:0@lo:400:kworker.0 00000100:00100000:1.0:1787135844.315127:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616382336:0@lo:400:kworker.0 00000100:00100000:2.0:1787135844.316571:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616382592 00000100:00100000:2.0:1787135844.317123:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616382592 00000100:00100000:2.0:1787135844.317187:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787135844.317196:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616382592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135844.318573:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135844.318625:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135844.318626:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616382720:0@lo:400:kworker.0 00000100:00100000:1.0:1787135844.318657:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616382848:0@lo:400:kworker.0 00000100:00100000:0.0:1787135844.318664:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135844.318713:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135844.318717:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616382464 00000100:00100000:0.0:1787135844.318724:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616382464 00000100:00100000:1.0:1787135844.318753:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616382336 00000100:00100000:1.0:1787135844.318758:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616382336 00000100:00100000:0.0:1787135844.318765:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616382720 00000100:00100000:0.0:1787135844.318770:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616382720 00000100:00100000:1.0:1787135844.319621:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787135844.319641:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616382464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135844.319700:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616382464:12345-0@lo:400:kworker.0 Request processed in 66us (4698us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135844.320248:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616382464:0@lo:400:kworker.0 00000100:00100000:2.0:1787135844.320411:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616382592:12345-0@lo:400:kworker.0 Request processed in 3215us (5420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135844.320421:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787135844.320441:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616382848 00000100:00100000:2.0:1787135844.320447:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616382848 00000100:00100000:2.0:1787135844.320491:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787135844.320497:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616382848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135844.320540:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616382848:12345-0@lo:400:kworker.0 Request processed in 43us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135844.320546:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787135844.320717:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd1180 x1873947616382592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135844.320730:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616382592:0@lo:400:kworker.0 00000100:00080000:2.0:1787135844.320773:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787135844.320780:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787135844.320783:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787135844.320799:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616382208 00000100:00100000:2.0:1787135844.320802:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616382208 00000100:00100000:2.0:1787135844.320831:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1787135844.320837:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616382208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135844.320872:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616382208:12345-0@lo:400:kworker.0 Request processed in 36us (2317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135844.320878:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787135844.321065:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787135844.321074:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616382336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135844.321122:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876caed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616382336:12345-0@lo:400:kworker.0 Request processed in 49us (2499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135844.321128:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787135844.321142:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787135844.321147:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616382720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135844.321173:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616382720:12345-0@lo:400:kworker.0 Request processed in 27us (2511us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135844.321187:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787135844.321217:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616382208:0@lo:400:kworker.0 00000100:00100000:0.0:1787135844.321228:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616382720:0@lo:400:kworker.0 00000100:00100000:0.0:1787135844.321271:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616382336:0@lo:400:kworker.0 00010000:00080000:0.0:1787135844.321284:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd2300 x1873947616382848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135844.321297:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616382848:0@lo:400:kworker.0 00000100:00100000:1.0:1787135844.324487:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1787135844.441759:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135844.824803:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616382976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135844.824886:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135844.824965:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616382976 00000100:00100000:2.0:1787135844.824972:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616382976 00000100:00100000:2.0:1787135844.825016:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787135844.825026:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616382976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787135844.825080:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135844.825142:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616382976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135844.825150:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1787135844.825190:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9842aac700 x1873947616382976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135844.825210:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616382976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135844.827806:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787135844.827830:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616383104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135844.828764:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135844.828826:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616383104 00000100:00100000:2.0:1787135844.828833:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616383104 00000100:00100000:3.0:1787135844.829016:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787135844.829028:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616383104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787135844.829101:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135844.829160:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616383104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135844.829168:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1787135844.829215:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9881fc1c00 x1873947616383104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135844.829234:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616383104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787135845.464324:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135845.734412:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135845.734458:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135845.734484:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135845.734513:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135845.734542:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595381376 00000100:00100000:3.0:1787135845.734551:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595381376 00000100:00100000:3.0:1787135845.734605:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595381504 00000100:00100000:3.0:1787135845.734608:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595381504 00000100:00100000:3.0:1787135845.734627:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:3.0:1787135845.734636:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595381376:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135845.734708:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595381376:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135845.734715:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:3.0:1787135845.734735:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:3.0:1787135845.734743:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595381504:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135845.734769:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595381504:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135845.734866:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595381120 00000100:00100000:1.0:1787135845.734872:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595381120 00000100:00100000:0.0:1787135845.735018:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595381248 00000100:00100000:0.0:1787135845.735023:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595381248 00000100:00100000:0.0:1787135845.735079:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:0.0:1787135845.735098:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595381248:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135845.735133:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595381248:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 37us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135845.735140:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:1.0:1787135845.735435:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:1.0:1787135845.735443:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:2359:x1873947595381120:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135845.735472:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:2359:x1873947595381120:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 30us (1703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135845.735478:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00080000:0.0:1787135845.736127:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787135845.736133:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787135845.736136:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787135845.736221:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00010000:00010000:0.0:1787135846.488323:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135847.518161:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135848.536887:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135849.432425:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616383616:0@lo:400:kworker.0 00000100:00100000:1.0:1787135849.432492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135849.432619:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616383360:0@lo:400:kworker.0 00000100:00100000:3.0:1787135849.432651:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135849.432677:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616383488:0@lo:400:kworker.0 00000100:00100000:3.0:1787135849.432699:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135849.432725:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616383360 00000100:00100000:3.0:1787135849.432733:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616383360 00000100:00100000:3.0:1787135849.432795:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616383488 00000100:00100000:3.0:1787135849.432798:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616383488 00000100:00100000:3.0:1787135849.432827:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787135849.432834:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616383360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135849.432885:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616383360:12345-0@lo:400:kworker.0 Request processed in 50us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135849.432892:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787135849.432906:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787135849.432912:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616383488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135849.432943:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616383488:12345-0@lo:400:kworker.0 Request processed in 30us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135849.432948:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1787135849.432968:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135849.433199:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616383616 00000100:00100000:1.0:1787135849.433204:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616383616 00000100:00100000:1.0:1787135849.433237:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787135849.433244:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616383616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135849.433280:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616383616:12345-0@lo:400:kworker.0 Request processed in 37us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135849.433286:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787135849.433319:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876cae680 x1873947616383616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135849.433344:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616383616:0@lo:400:kworker.0 00000100:00080000:3.0:1787135849.433394:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787135849.433423:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616383360:0@lo:400:kworker.0 00000100:00100000:3.0:1787135849.433430:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616383872:0@lo:400:kworker.0 00000100:00100000:3.0:1787135849.433453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135849.433491:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787135849.433497:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616383232:0@lo:400:kworker.0 00000100:00100000:3.0:1787135849.433523:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135849.433558:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616383744:0@lo:400:kworker.0 00000100:00100000:3.0:1787135849.433580:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135849.433604:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616383872 00000100:00100000:3.0:1787135849.433608:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616383872 00000100:00100000:3.0:1787135849.433636:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787135849.433642:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616383872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135849.433677:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616383872:12345-0@lo:400:kworker.0 Request processed in 35us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135849.433683:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787135849.433700:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616383232 00000100:00100000:3.0:1787135849.433704:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616383232 00000100:00100000:3.0:1787135849.433726:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1787135849.433731:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616383232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135849.433776:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616383232:12345-0@lo:400:kworker.0 Request processed in 44us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135849.433782:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:3.0:1787135849.433806:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787135849.433816:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616383744 00000100:00100000:3.0:1787135849.433819:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616383744 00000100:00100000:3.0:1787135849.433843:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787135849.433848:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616383744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135849.433874:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616383744:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135849.433880:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787135849.433901:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135849.433918:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616383232:0@lo:400:kworker.0 00000100:00100000:3.0:1787135849.433928:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616383744:0@lo:400:kworker.0 00010000:00080000:3.0:1787135849.433937:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876caca80 x1873947616383872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135849.433945:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616383872:0@lo:400:kworker.0 00000100:00100000:1.0:1787135849.434267:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616383488:0@lo:400:kworker.0 00010000:00010000:3.0:1787135849.560234:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787135849.760007:0:8784:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1787135849.944302:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787135849.944325:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616384000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135849.944465:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135849.944531:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616384000 00000100:00100000:0.0:1787135849.944538:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616384000 00000100:00100000:0.0:1787135849.944595:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787135849.944605:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616384000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787135849.945594:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135849.946571:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616384000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1963us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135849.946582:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787135849.952178:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787135849.952203:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616384128:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1787135849.954620:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9881fc0e00 x1873947616384000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135849.954645:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616384000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787135849.955403:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135849.955903:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616384128 00000100:00100000:3.0:1787135849.955912:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616384128 00000100:00100000:3.0:1787135849.955976:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787135849.955986:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616384128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787135849.956018:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135849.956104:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616384128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135849.956113:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1787135849.956133:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd0000 x1873947616384128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135849.956155:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616384128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787135850.588993:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135850.873477:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135850.873747:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135850.873778:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135850.873804:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135850.873834:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595381632 00000100:00100000:0.0:1787135850.873844:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595381632 00000100:00100000:0.0:1787135850.873890:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:0.0:1787135850.873899:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:2359:x1873947595381632:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135850.873963:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:2359:x1873947595381632:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 65us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135850.873972:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:0.0:1787135850.874003:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595381888 00000100:00100000:0.0:1787135850.874007:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595381888 00000100:00100000:0.0:1787135850.874039:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595382016 00000100:00100000:0.0:1787135850.874042:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595382016 00000100:00100000:0.0:1787135850.874092:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:0.0:1787135850.874100:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595381888:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135850.874127:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595381888:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135850.874135:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:0.0:1787135850.874156:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:0.0:1787135850.874162:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595382016:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135850.874190:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595382016:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135850.874197:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:0.0:1787135850.874215:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595381760 00000100:00100000:0.0:1787135850.874218:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595381760 00000100:00100000:0.0:1787135850.874246:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:0.0:1787135850.874253:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595381760:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135850.874279:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595381760:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135850.874285:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00080000:0.0:1787135850.874415:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787135850.874420:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787135850.874422:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787135851.609553:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135852.632304:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135853.657846:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135854.554803:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616384384:0@lo:400:kworker.0 00000100:00100000:2.0:1787135854.554875:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135854.554922:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616384896:0@lo:400:kworker.0 00000100:00100000:2.0:1787135854.554942:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135854.554970:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787135854.554974:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616384256:0@lo:400:kworker.0 00000100:00100000:2.0:1787135854.554998:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135854.555015:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616384768:0@lo:400:kworker.0 00000100:00100000:2.0:1787135854.555076:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135854.555101:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616384512:0@lo:400:kworker.0 00000100:00100000:2.0:1787135854.555120:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135854.555134:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787135854.555138:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616384640:0@lo:400:kworker.0 00000100:00100000:2.0:1787135854.555153:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135854.555175:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616384384 00000100:00100000:2.0:1787135854.555181:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616384384 00000100:00100000:2.0:1787135854.555419:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616384768 00000100:00100000:2.0:1787135854.555423:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616384768 00000100:00100000:2.0:1787135854.555441:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616384512 00000100:00100000:2.0:1787135854.555504:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616384512 00000100:00100000:2.0:1787135854.555523:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787135854.555531:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616384384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135854.555576:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616384384:12345-0@lo:400:kworker.0 Request processed in 46us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135854.555583:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787135854.555597:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787135854.555602:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616384768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135854.555623:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616384768:12345-0@lo:400:kworker.0 Request processed in 22us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135854.555628:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787135854.555637:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787135854.555641:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616384512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135854.556168:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616384512:12345-0@lo:400:kworker.0 Request processed in 524us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135854.556184:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787135854.556411:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616384256 00000100:00100000:2.0:1787135854.556418:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616384256 00000100:00100000:2.0:1787135854.557563:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1787135854.557576:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616384256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135854.557646:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616384256:12345-0@lo:400:kworker.0 Request processed in 74us (2645us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135854.557652:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1787135854.557731:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616384896 00000100:00100000:0.0:1787135854.557737:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616384896 00000100:00100000:0.0:1787135854.557771:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616384640 00000100:00100000:0.0:1787135854.557774:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616384640 00000100:00100000:0.0:1787135854.557790:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787135854.557796:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616384896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135854.557834:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616384896:12345-0@lo:400:kworker.0 Request processed in 38us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135854.557840:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787135854.557853:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787135854.557866:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616384640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135854.557896:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616384640:12345-0@lo:400:kworker.0 Request processed in 31us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135854.557902:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787135854.557929:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787135854.557933:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787135854.557935:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135854.563739:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616384256:0@lo:400:kworker.0 00000100:00100000:3.0:1787135854.563764:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616384768:0@lo:400:kworker.0 00000100:00100000:3.0:1787135854.563776:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616384384:0@lo:400:kworker.0 00010000:00080000:3.0:1787135854.563788:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd0e00 x1873947616384896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135854.563808:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616384896:0@lo:400:kworker.0 00010000:00080000:2.0:1787135854.564880:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd2d80 x1873947616384640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135854.564896:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616384640:0@lo:400:kworker.0 00000100:00100000:2.0:1787135854.564913:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616384512:0@lo:400:kworker.0 00000001:02000400:2.0:1787135854.654561:0:9030:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing yml_node 00010000:00010000:3.0:1787135854.680747:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135855.064678:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616385024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787135855.064751:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135855.064911:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787135855.064920:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616385152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787135855.064949:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135855.065040:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616385024 00000100:00100000:0.0:1787135855.065237:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616385024 00000100:00100000:0.0:1787135855.065282:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616385152 00000100:00100000:0.0:1787135855.065290:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616385152 00000100:00100000:0.0:1787135855.065304:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787135855.065310:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616385024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787135855.065336:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135855.065400:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876caca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616385024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135855.065409:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1787135855.065416:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876cae680 x1873947616385024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135855.065425:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787135855.065432:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616385152:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787135855.065434:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616385024:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787135855.065451:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135855.065488:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876caf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616385152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135855.065495:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1787135855.065499:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd34a80 x1873947616385152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135855.065512:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616385152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787135855.704336:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135855.977162:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135855.977206:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135855.977299:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595382272 00000100:00100000:2.0:1787135855.977309:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595382272 00000100:00100000:2.0:1787135855.977383:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:2.0:1787135855.977393:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595382272:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135855.977458:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595382272:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 67us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135855.977464:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00080000:3.0:1787135855.977796:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135855.978004:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595382144 00000100:00100000:1.0:1787135855.978022:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595382144 00000100:00100000:1.0:1787135855.978168:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:1.0:1787135855.978176:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:2361:x1873947595382144:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135855.978231:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:2361:x1873947595382144:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 56us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135855.978237:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:1.0:1787135855.987497:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135855.987545:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135855.987588:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595382400 00000100:00100000:1.0:1787135855.987598:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595382400 00000100:00100000:1.0:1787135855.987645:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595382528 00000100:00100000:1.0:1787135855.987648:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595382528 00000100:00100000:1.0:1787135855.987664:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1787135855.987674:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2358:x1873947595382400:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:1.0:1787135855.987706:0:6674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f20239b 00000100:00080000:1.0:1787135855.987715:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8e9842bc7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787135855.987751:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787135855.989689:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+2:2358:x1873947595382400:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 2006us (2191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135855.989701:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1787135855.989729:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:1.0:1787135855.989739:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2358:x1873947595382528:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:1.0:1787135855.989765:0:6674:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f2023a2 00000100:00080000:1.0:1787135855.989774:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8e9852e58000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787135855.989814:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787135855.990121:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+2:2358:x1873947595382528:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 384us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135855.990138:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00080000:1.0:1787135855.990162:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787135855.990166:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787135855.990236:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135855.990243:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135856.728562:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135857.753523:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787135858.330681:0:9222:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.8 00010000:00010000:1.0:1787135858.777004:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787135859.208497:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000020:00000080:0.0:1787135859.208507:0:7625:0:(genops.c:906:class_export_put()) final put ffff8e9842bc6000/a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000020:00000080:3.0:1787135859.208643:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9842bc6000/a1006dc5-9c90-4762-af1c-1ab0be9a05b8 for lustre-OST0001 00000020:00000080:3.0:1787135859.208798:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9852e58000 for lustre-OST0001 00000100:00100000:3.0:1787135859.675579:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616385664:0@lo:400:kworker.0 00000100:00100000:3.0:1787135859.675653:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135859.675717:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787135859.675723:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616385536:0@lo:400:kworker.0 00000100:00100000:3.0:1787135859.675747:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135859.675976:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616385280:0@lo:400:kworker.0 00000100:00100000:2.0:1787135859.676022:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135859.676074:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616385792:0@lo:400:kworker.0 00000100:00100000:2.0:1787135859.676114:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135859.676143:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787135859.676148:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616385408:0@lo:400:kworker.0 00000100:00100000:2.0:1787135859.676168:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135859.676194:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616385920:0@lo:400:kworker.0 00000100:00100000:2.0:1787135859.676215:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135859.676242:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616385536 00000100:00100000:2.0:1787135859.676250:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616385536 00000100:00100000:2.0:1787135859.676295:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616385792 00000100:00100000:2.0:1787135859.676299:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616385792 00000100:00100000:2.0:1787135859.676312:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616385408 00000100:00100000:2.0:1787135859.676315:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616385408 00000100:00100000:2.0:1787135859.676328:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787135859.676336:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616385536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135859.676388:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616385536:12345-0@lo:400:kworker.0 Request processed in 51us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135859.676395:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787135859.676412:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787135859.676417:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616385792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135859.676448:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616385792:12345-0@lo:400:kworker.0 Request processed in 31us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135859.676454:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787135859.676464:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787135859.676471:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616385408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135859.676508:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616385408:12345-0@lo:400:kworker.0 Request processed in 39us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135859.676514:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787135859.676675:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616385664 00000100:00100000:1.0:1787135859.676679:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616385664 00000100:00100000:1.0:1787135859.676708:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616385920 00000100:00100000:1.0:1787135859.676711:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616385920 00000100:00100000:1.0:1787135859.676726:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787135859.676734:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616385664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135859.676771:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616385664:12345-0@lo:400:kworker.0 Request processed in 39us (1119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135859.676777:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787135859.676789:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787135859.676794:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616385920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135859.676821:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616385920:12345-0@lo:400:kworker.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135859.676826:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787135859.676842:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787135859.676846:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787135859.676849:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135859.676900:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616385536:0@lo:400:kworker.0 00010000:00080000:1.0:1787135859.676914:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9842aaed80 x1873947616385664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135859.676939:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616385664:0@lo:400:kworker.0 00000100:00100000:2.0:1787135859.677082:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616385408:0@lo:400:kworker.0 00010000:00080000:2.0:1787135859.677096:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98606d4000 x1873947616385920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135859.677104:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616385920:0@lo:400:kworker.0 00000100:00100000:2.0:1787135859.677115:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616385792:0@lo:400:kworker.0 00000100:00100000:3.0:1787135859.677806:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616385280 00000100:00100000:3.0:1787135859.677814:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616385280 00000100:00100000:3.0:1787135859.677924:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1787135859.677933:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616385280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135859.678007:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616385280:12345-0@lo:400:kworker.0 Request processed in 76us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135859.678124:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616385280:0@lo:400:kworker.0 00000100:00100000:3.0:1787135859.680534:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00010000:00010000:2.0:1787135859.805296:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135860.184283:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616386048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787135860.184364:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135860.184497:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616386176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787135860.184529:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135860.184574:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616386048 00000100:00100000:1.0:1787135860.184582:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616386048 00000100:00100000:1.0:1787135860.184617:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616386176 00000100:00100000:1.0:1787135860.184620:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616386176 00000100:00100000:1.0:1787135860.184635:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787135860.184642:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616386048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787135860.184673:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135860.196449:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616386048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11797us (12076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135860.196464:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787135860.196500:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787135860.196513:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616386176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787135860.196548:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135860.196629:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616386176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (12099us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135860.196635:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1787135860.196881:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd37480 x1873947616386176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135860.196903:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616386176:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787135860.197151:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876cae300 x1873947616386048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135860.197170:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616386048:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787135860.729355:0:9323:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.8 00000001:00100000:0.0:1787135860.785776:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000020:00000080:0.0:1787135860.785799:0:6697:0:(genops.c:906:class_export_put()) final put ffff8e984758c800/a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000020:00000080:3.0:1787135860.785940:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e984758c800/a1006dc5-9c90-4762-af1c-1ab0be9a05b8 for lustre-OST0000 00000020:00000080:3.0:1787135860.786001:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9842bc7800 for lustre-OST0000 00010000:00010000:3.0:1787135860.826949:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135861.102861:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135861.102910:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135861.102938:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595382656 00000100:00100000:0.0:1787135861.102948:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595382656 00000100:00100000:0.0:1787135861.103004:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:0.0:1787135861.103013:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:2359:x1873947595382656:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135861.103092:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:2359:x1873947595382656:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 79us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135861.103100:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:3.0:1787135861.104398:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595382784 00000100:00100000:3.0:1787135861.104407:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595382784 00000100:00100000:3.0:1787135861.104469:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:3.0:1787135861.104479:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595382784:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135861.104537:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595382784:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 60us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135861.104544:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00080000:0.0:1787135861.105019:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787135861.849078:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135862.873447:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787135863.111873:0:9422:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.8 00010000:00010000:2.0:1787135863.896568:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787135864.651563:0:9470:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 19 06:37:43 EDT 2026 00000100:00100000:2.0:1787135864.795775:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616386304:0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.795840:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135864.795881:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616386816:0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.795966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135864.795992:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787135864.795998:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616386432:0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.796020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135864.796034:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616386944:0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.796076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135864.796103:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616386688:0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.796134:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135864.796153:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787135864.796159:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616386560:0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.796178:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135864.796202:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616386816 00000100:00100000:2.0:1787135864.796208:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616386816 00000100:00100000:2.0:1787135864.796248:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616386432 00000100:00100000:2.0:1787135864.796251:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616386432 00000100:00100000:2.0:1787135864.796263:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616386560 00000100:00100000:2.0:1787135864.796265:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616386560 00000100:00100000:2.0:1787135864.796281:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787135864.796289:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616386816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.796339:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987482b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616386816:12345-0@lo:400:kworker.0 Request processed in 50us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135864.796347:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787135864.796361:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787135864.796368:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616386432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.796393:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616386432:12345-0@lo:400:kworker.0 Request processed in 26us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135864.796399:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787135864.796410:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787135864.796416:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616386560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.796461:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616386560:12345-0@lo:400:kworker.0 Request processed in 45us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135864.796467:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787135864.796486:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616386944 00000100:00100000:2.0:1787135864.796489:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616386944 00000100:00100000:2.0:1787135864.796516:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616386688 00000100:00100000:2.0:1787135864.796520:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616386688 00000100:00100000:2.0:1787135864.796534:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787135864.796540:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616386944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.796571:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616386944:12345-0@lo:400:kworker.0 Request processed in 31us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135864.796577:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787135864.796588:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787135864.796593:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616386688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.796619:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616386688:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135864.796625:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787135864.797778:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787135864.797785:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787135864.797787:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135864.798616:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616386304 00000100:00100000:3.0:1787135864.798624:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616386304 00000100:00100000:3.0:1787135864.798907:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1787135864.798917:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616386304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135864.799012:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616386304:12345-0@lo:400:kworker.0 Request processed in 97us (3171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135864.799023:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1787135864.799188:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616386560:0@lo:400:kworker.0 00010000:00080000:2.0:1787135864.799205:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd0000 x1873947616386688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135864.799217:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616386688:0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.799255:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616386432:0@lo:400:kworker.0 00010000:00080000:2.0:1787135864.799345:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9874829500 x1873947616386944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135864.799356:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874829500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616386944:0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.799365:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616386304:0@lo:400:kworker.0 00000100:00100000:2.0:1787135864.799376:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616386816:0@lo:400:kworker.0 00010000:00010000:2.0:1787135864.920570:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135865.305945:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616387072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787135865.306029:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135865.306782:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616387072 00000100:00100000:3.0:1787135865.306793:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616387072 00000100:00100000:3.0:1787135865.306843:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787135865.306853:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616387072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787135865.306887:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135865.306941:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616387072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135865.306968:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787135865.308485:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616387200:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135865.308547:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787135865.309304:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd35f80 x1873947616387072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135865.309336:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616387072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135865.316175:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616387200 00000100:00100000:0.0:1787135865.316191:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616387200 00000100:00100000:0.0:1787135865.316249:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787135865.316259:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616387200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787135865.316307:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135865.316391:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616387200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (7843us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135865.316400:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787135865.316431:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd36680 x1873947616387200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135865.316455:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616387200:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787135865.951934:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135866.218044:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135866.218114:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135866.218223:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595382912 00000100:00100000:1.0:1787135866.218233:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595382912 00000100:00100000:1.0:1787135866.218287:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:1.0:1787135866.218297:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:2361:x1873947595382912:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135866.218371:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:2361:x1873947595382912:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 75us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135866.218396:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:2.0:1787135866.218670:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595383040 00000100:00100000:2.0:1787135866.218675:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595383040 00000100:00100000:2.0:1787135866.218881:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:2.0:1787135866.218900:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595383040:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135866.219112:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595383040:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 213us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135866.219120:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00080000:0.0:1787135866.219259:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787135866.973022:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135867.992893:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135869.016501:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135869.915706:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616387584:0@lo:400:kworker.0 00000100:00100000:1.0:1787135869.915892:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135869.915967:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787135869.915974:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616387712:0@lo:400:kworker.0 00000100:00100000:1.0:1787135869.916013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135869.916074:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616387584 00000100:00100000:1.0:1787135869.916081:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616387584 00000100:00100000:1.0:1787135869.916299:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787135869.916309:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616387584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135869.916361:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616387584:12345-0@lo:400:kworker.0 Request processed in 54us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135869.916369:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787135869.916395:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616387712 00000100:00100000:1.0:1787135869.916398:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616387712 00000100:00100000:1.0:1787135869.916426:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787135869.916432:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616387712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135869.916463:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616387712:12345-0@lo:400:kworker.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135869.916469:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787135869.916508:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987c0a4a80 x1873947616387712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135869.916521:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616387712:0@lo:400:kworker.0 00000100:00100000:1.0:1787135869.916533:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616387584:0@lo:400:kworker.0 00000100:00100000:2.0:1787135869.916672:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616387328:0@lo:400:kworker.0 00000100:00100000:2.0:1787135869.916709:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135869.916744:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616387840:0@lo:400:kworker.0 00000100:00100000:2.0:1787135869.916768:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135869.916786:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787135869.916793:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616387456:0@lo:400:kworker.0 00000100:00100000:2.0:1787135869.916813:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135869.916830:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616387968:0@lo:400:kworker.0 00000100:00100000:2.0:1787135869.916849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135869.916871:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616387840 00000100:00100000:2.0:1787135869.916875:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616387840 00000100:00100000:2.0:1787135869.916897:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616387456 00000100:00100000:2.0:1787135869.916901:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616387456 00000100:00100000:2.0:1787135869.916949:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787135869.916956:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616387840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135869.917005:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616387840:12345-0@lo:400:kworker.0 Request processed in 50us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135869.917012:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787135869.917025:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787135869.917031:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616387456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135869.917075:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616387456:12345-0@lo:400:kworker.0 Request processed in 45us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135869.917080:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787135869.917234:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616387456:0@lo:400:kworker.0 00000100:00100000:2.0:1787135869.917244:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616387840:0@lo:400:kworker.0 00000100:00100000:1.0:1787135869.917411:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616387328 00000100:00100000:1.0:1787135869.917423:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616387328 00000100:00100000:1.0:1787135869.917461:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787135869.917468:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616387328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135869.917506:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616387328:12345-0@lo:400:kworker.0 Request processed in 40us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135869.917513:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1787135869.917553:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616387328:0@lo:400:kworker.0 00000100:00080000:0.0:1787135869.917622:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787135869.917627:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135869.917637:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616387968 00000100:00100000:0.0:1787135869.917641:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616387968 00000100:00100000:0.0:1787135869.917681:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787135869.917688:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616387968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135869.917727:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616387968:12345-0@lo:400:kworker.0 Request processed in 40us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135869.917733:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1787135869.917762:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987c0a4380 x1873947616387968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135869.917773:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616387968:0@lo:400:kworker.0 00000100:00080000:1.0:1787135869.917813:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787135870.040199:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135870.424295:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616388096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135870.424379:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135870.424450:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787135870.424457:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616388224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135870.424499:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135870.424549:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616388096 00000100:00100000:2.0:1787135870.424555:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616388096 00000100:00100000:0.0:1787135870.424558:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616388224 00000100:00100000:0.0:1787135870.424565:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616388224 00000100:00100000:0.0:1787135870.424600:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787135870.424605:0:6676:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1787135870.424614:0:6676:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1787135870.424778:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616388096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787135870.424814:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135870.424868:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616388096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135870.424876:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787135870.424896:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787135870.424903:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616388224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787135870.424933:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135870.424963:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616388224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135870.424979:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1787135870.425015:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd35500 x1873947616388224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135870.425033:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616388224:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787135870.425078:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd0000 x1873947616388096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135870.425090:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616388096:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787135871.066831:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135871.339889:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135871.339980:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135871.340169:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595383296 00000100:00100000:2.0:1787135871.340243:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595383296 00000100:00100000:2.0:1787135871.340313:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1787135871.340324:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595383296:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135871.340406:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595383296:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 83us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135871.340414:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00080000:0.0:1787135871.340477:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135871.341707:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595383168 00000100:00100000:3.0:1787135871.341718:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595383168 00000100:00100000:3.0:1787135871.341772:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:3.0:1787135871.341781:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:2359:x1873947595383168:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135871.341838:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:2359:x1873947595383168:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 58us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135871.341845:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 202 00010000:00010000:1.0:1787135872.093965:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135873.125774:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135874.138026:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135875.035064:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616388352:0@lo:400:kworker.0 00000100:00100000:3.0:1787135875.035138:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135875.035193:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616388864:0@lo:400:kworker.0 00000100:00100000:3.0:1787135875.035220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135875.035258:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787135875.035264:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616388480:0@lo:400:kworker.0 00000100:00100000:3.0:1787135875.035287:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135875.035305:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616388992:0@lo:400:kworker.0 00000100:00100000:3.0:1787135875.035348:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135875.035384:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616388352 00000100:00100000:3.0:1787135875.035391:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616388352 00000100:00100000:3.0:1787135875.035435:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787135875.035455:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616388352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135875.035510:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616388352:12345-0@lo:400:kworker.0 Request processed in 58us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135875.035517:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1787135875.035546:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616388864 00000100:00100000:3.0:1787135875.035550:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616388864 00000100:00100000:3.0:1787135875.035591:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616388480 00000100:00100000:3.0:1787135875.035595:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616388480 00000100:00100000:3.0:1787135875.035613:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787135875.035620:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616388864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135875.035650:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616388864:12345-0@lo:400:kworker.0 Request processed in 31us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135875.035657:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787135875.035668:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787135875.035673:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616388480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135875.035699:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616388480:12345-0@lo:400:kworker.0 Request processed in 26us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135875.035705:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787135875.035723:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616388992 00000100:00100000:3.0:1787135875.035727:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616388992 00000100:00100000:3.0:1787135875.035753:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787135875.035759:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616388992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135875.035788:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616388992:12345-0@lo:400:kworker.0 Request processed in 29us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135875.035794:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1787135875.035811:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787135875.035815:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135875.035927:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616388480:0@lo:400:kworker.0 00010000:00080000:3.0:1787135875.035948:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98606d6300 x1873947616388992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135875.035957:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616388992:0@lo:400:kworker.0 00000100:00100000:3.0:1787135875.035964:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616388352:0@lo:400:kworker.0 00000100:00100000:3.0:1787135875.035973:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616388864:0@lo:400:kworker.0 00000100:00100000:1.0:1787135875.036765:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616388608:0@lo:400:kworker.0 00000100:00100000:2.0:1787135875.036772:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616388736:0@lo:400:kworker.0 00000100:00100000:2.0:1787135875.037231:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135875.037316:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616388736 00000100:00100000:0.0:1787135875.037322:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616388736 00000100:00100000:0.0:1787135875.037373:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787135875.037381:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616388736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135875.037427:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616388736:12345-0@lo:400:kworker.0 Request processed in 47us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135875.037433:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1787135875.037473:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98606d6680 x1873947616388736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135891 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135875.037485:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616388736:0@lo:400:kworker.0 00000100:00080000:2.0:1787135875.037634:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787135875.038137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135875.042137:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616388608 00000100:00100000:2.0:1787135875.042218:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616388608 00000100:00100000:2.0:1787135875.042398:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787135875.042409:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616388608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135875.042505:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616388608:12345-0@lo:400:kworker.0 Request processed in 98us (5274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135875.042512:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787135875.045339:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616388608:0@lo:400:kworker.0 00000100:00080000:0.0:1787135875.046293:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787135875.160276:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135875.544996:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787135875.545019:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616389120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135875.545112:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135875.545178:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616389120 00000100:00100000:0.0:1787135875.545186:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616389120 00000100:00100000:0.0:1787135875.545230:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787135875.545239:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616389120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787135875.545273:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135875.545313:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616389120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135875.545320:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1787135875.545359:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987bd37100 x1873947616389120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135875.545377:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987bd37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616389120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135875.545495:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787135875.545505:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616389248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135875.545534:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135875.545885:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616389248 00000100:00100000:0.0:1787135875.545890:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616389248 00000100:00100000:0.0:1787135875.545920:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787135875.545926:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616389248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787135875.545945:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135875.545979:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616389248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135875.545985:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787135875.546081:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9881fdd180 x1873947616389248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135875.546095:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616389248:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787135876.184542:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135876.458298:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135876.458341:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135876.458373:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595383424 00000100:00100000:2.0:1787135876.458383:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595383424 00000100:00100000:2.0:1787135876.458429:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:2.0:1787135876.458439:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:2362:x1873947595383424:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135876.458518:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+10:2362:x1873947595383424:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 80us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135876.458528:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:1.0:1787135876.459685:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595383552 00000100:00100000:1.0:1787135876.459696:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595383552 00000100:00100000:1.0:1787135876.459776:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:1.0:1787135876.459787:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2362:x1873947595383552:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135876.459848:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2362:x1873947595383552:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 63us (1559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135876.459855:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00080000:2.0:1787135876.459999:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787135877.209144:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135878.232539:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787135878.478423:0:10102:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 06:37:57 (1787135877) === 00000100:00100000:2.0:1787135878.922274:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135878.922355:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595383680 00000100:00100000:3.0:1787135878.922364:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595383680 00000100:00100000:3.0:1787135878.922414:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 205 00000100:00100000:3.0:1787135878.922423:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+10:8124:x1873947595383680:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787135878.922440:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135878.922456:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511da800/0xf5850c552f202466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b71814a expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135878.922484:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511da800/0xf5850c552f202466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71814a expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135878.922496:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511da800/0xf5850c552f202466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71814a expref: 11 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135878.922505:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da800, rc 0) 00000100:00100000:3.0:1787135878.922696:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+11:8124:x1873947595383680:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 273us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135878.922704:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 205 00000100:00100000:0.0:1787135878.932750:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135878.932842:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595383808 00000100:00100000:3.0:1787135878.932862:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595383808 00000100:00100000:3.0:1787135878.932918:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 206 00000100:00100000:3.0:1787135878.932942:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+11:8124:x1873947595383808:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787135878.933251:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+11:8124:x1873947595383808:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 310us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135878.933259:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 206 00000100:00100000:0.0:1787135878.939117:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135878.939212:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595383936 00000100:00100000:3.0:1787135878.939221:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595383936 00000100:00100000:3.0:1787135878.939279:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 207 00000100:00100000:3.0:1787135878.939289:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+11:8124:x1873947595383936:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787135878.939496:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+11:8124:x1873947595383936:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 208us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135878.939504:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 207 00000100:00100000:0.0:1787135878.951233:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135878.951323:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595384064 00000100:00100000:2.0:1787135878.951334:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595384064 00000100:00100000:2.0:1787135878.951398:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 208 00000100:00100000:2.0:1787135878.951411:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+11:8128:x1873947595384064:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787135878.951687:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+11:8128:x1873947595384064:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 278us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135878.951695:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 208 00000100:00100000:1.0:1787135878.969973:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135878.973295:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595384192 00000100:00100000:0.0:1787135878.973310:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595384192 00000100:00100000:0.0:1787135878.973448:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 209 00000100:00100000:0.0:1787135878.973459:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+11:8128:x1873947595384192:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787135878.974484:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+11:8128:x1873947595384192:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 1022us (4516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135878.974494:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 209 00000100:00100000:0.0:1787135878.982904:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135878.983880:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595384320 00000100:00100000:3.0:1787135878.983892:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595384320 00000100:00100000:3.0:1787135878.984000:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 210 00000100:00100000:3.0:1787135878.984010:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+11:8124:x1873947595384320:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787135878.984027:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135878.984044:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511dba00/0xf5850c552f20246d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b718174 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135878.984087:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511dba00/0xf5850c552f20246d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718174 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135878.984099:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511dba00/0xf5850c552f20246d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718174 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135878.984108:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dba00, rc 0) 00000100:00100000:3.0:1787135878.984187:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+12:8124:x1873947595384320:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 178us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135878.984194:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 210 00000100:00100000:1.0:1787135878.991236:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135878.991334:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595384448 00000100:00100000:0.0:1787135878.991344:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595384448 00000100:00100000:0.0:1787135878.991398:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 211 00000100:00100000:0.0:1787135878.991408:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+12:8124:x1873947595384448:12345-192.168.203.38@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787135878.991433:0:5813:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787135878.991450:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787135878.991454:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787135878.991456:0:5813:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787135878.991458:0:5813:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787135878.993583:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+12:8124:x1873947595384448:12345-192.168.203.38@tcp:256:mount.lustre.0 Request processed in 2165us (2345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135878.993597:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 211 00000100:00100000:1.0:1787135879.000585:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135879.000670:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595384576 00000100:00100000:3.0:1787135879.000681:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595384576 00000100:00100000:3.0:1787135879.000742:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:3.0:1787135879.000752:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+12:8124:x1873947595384576:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787135879.000769:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135879.000786:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511da200/0xf5850c552f202474 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b71817b expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135879.000813:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511da200/0xf5850c552f202474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71817b expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135879.000823:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511da200/0xf5850c552f202474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71817b expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135879.000832:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da200, rc 0) 00000100:00100000:3.0:1787135879.001115:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:8124:x1873947595384576:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 363us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135879.001123:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:1.0:1787135879.003081:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135879.003169:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595384704 00000100:00100000:0.0:1787135879.003178:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595384704 00000100:00100000:0.0:1787135879.003237:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 213 00000100:00100000:0.0:1787135879.003246:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:8124:x1873947595384704:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787135879.003510:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:8124:x1873947595384704:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 264us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135879.003518:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 213 00000100:00100000:1.0:1787135879.005397:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135879.005484:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595384832 00000100:00100000:3.0:1787135879.005493:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595384832 00000100:00100000:3.0:1787135879.005547:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 214 00000100:00100000:3.0:1787135879.005565:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:8124:x1873947595384832:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787135879.005794:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:8124:x1873947595384832:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 231us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135879.005811:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 214 00000100:00100000:1.0:1787135879.008534:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135879.008624:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595384960 00000100:00100000:2.0:1787135879.008634:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595384960 00000100:00100000:2.0:1787135879.008683:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 215 00000100:00100000:2.0:1787135879.008693:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:8132:x1873947595384960:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787135879.008952:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:8132:x1873947595384960:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 259us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135879.008960:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 215 00000100:00100000:2.0:1787135879.011269:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135879.011352:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595385088 00000100:00100000:1.0:1787135879.011362:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595385088 00000100:00100000:1.0:1787135879.011411:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 216 00000100:00100000:1.0:1787135879.011422:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:8132:x1873947595385088:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787135879.011665:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:8132:x1873947595385088:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 245us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135879.011674:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 216 00000100:00100000:1.0:1787135879.018610:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135879.018776:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595385600 00000100:00100000:3.0:1787135879.018786:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595385600 00000100:00100000:3.0:1787135879.018865:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1787135879.018876:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595385600:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135879.018946:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595385600:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 72us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135879.018953:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:1.0:1787135879.019109:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00080000:0.0:1787135879.019480:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135879.019562:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595385216 00000100:00100000:2.0:1787135879.019569:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595385216 00000100:00100000:2.0:1787135879.019606:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1787135879.019612:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1873947595385216:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787135879.019643:0:5822:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from 0410dc70-43f2-4e7e-8b1a-609a240ccdf4@192.168.203.38@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:2.0:1787135879.019678:0:5822:0:(genops.c:1406:class_connect()) connect: client 0410dc70-43f2-4e7e-8b1a-609a240ccdf4, cookie 0xf5850c552f20247b 00000004:00100000:2.0:1787135879.019705:0:5822:0:(mdt_handler.c:7486:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787135879.020618:0:5822:0:(import.c:65:import_set_state_nolock()) ffff8e9876a71000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787135879.020690:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2358:x1873947595385216:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 1075us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135879.020699:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1787135879.028099:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135879.028193:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595385344 00000100:00100000:3.0:1787135879.028212:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595385344 00000100:00100000:3.0:1787135879.028281:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:3.0:1787135879.028291:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:0:x1873947595385344:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787135879.028332:0:5823:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787135879.028424:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:0:x1873947595385344:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 132us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135879.028432:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:1.0:1787135879.029022:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135879.029159:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595385472 00000100:00100000:3.0:1787135879.029166:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595385472 00000100:00100000:3.0:1787135879.029213:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:3.0:1787135879.029222:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:8124:x1873947595385472:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787135879.029241:0:5821:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787135879.029281:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:8124:x1873947595385472:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 61us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135879.029288:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00080000:0.0:1787135879.030257:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135879.031097:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135879.031298:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595385728 00000100:00100000:3.0:1787135879.031320:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595385728 00000100:00100000:3.0:1787135879.031372:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:3.0:1787135879.031383:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:8124:x1873947595385728:12345-192.168.203.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787135879.031586:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:8124:x1873947595385728:12345-192.168.203.38@tcp:40:mount.lustre.0 Request processed in 205us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135879.031594:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:2.0:1787135879.033392:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135879.033428:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135879.033480:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135879.033568:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595386112 00000100:00100000:1.0:1787135879.033578:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595386112 00000100:00100000:1.0:1787135879.033636:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:1.0:1787135879.033646:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:8124:x1873947595386112:12345-192.168.203.38@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787135879.033884:0:5824:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787135879.034027:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:8124:x1873947595386112:12345-192.168.203.38@tcp:33:mount.lustre.0 Request processed in 382us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135879.034035:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:0.0:1787135879.034368:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595385856 00000100:00100000:0.0:1787135879.034374:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595385856 00000100:00100000:0.0:1787135879.034405:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595385984 00000100:00100000:0.0:1787135879.034408:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595385984 00000100:00100000:0.0:1787135879.034419:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:0.0:1787135879.034424:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1873947595385856:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787135879.034446:0:6674:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from 0410dc70-43f2-4e7e-8b1a-609a240ccdf4@192.168.203.38@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1787135879.034471:0:6674:0:(genops.c:1406:class_connect()) connect: client 0410dc70-43f2-4e7e-8b1a-609a240ccdf4, cookie 0xf5850c552f202482 00002000:00100000:0.0:1787135879.034482:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0410dc70-43f2-4e7e-8b1a-609a240ccdf4/ffff8e9852e5f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113908 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787135879.034503:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787135879.034690:0:6674:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787135879.034718:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8e9852e59800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787135879.034773:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2358:x1873947595385856:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 342us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135879.034780:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:0.0:1787135879.034794:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:0.0:1787135879.034799:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1873947595385984:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787135879.034813:0:6674:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from 0410dc70-43f2-4e7e-8b1a-609a240ccdf4@192.168.203.38@tcp t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:0.0:1787135879.034828:0:6674:0:(genops.c:1406:class_connect()) connect: client 0410dc70-43f2-4e7e-8b1a-609a240ccdf4, cookie 0xf5850c552f202489 00002000:00100000:0.0:1787135879.034833:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0410dc70-43f2-4e7e-8b1a-609a240ccdf4/ffff8e9852e5f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113908 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787135879.034845:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787135879.034976:0:6674:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787135879.034991:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8e9852e58000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787135879.035015:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2358:x1873947595385984:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 214us (1586us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135879.035031:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00010000:00010000:1.0:1787135879.256553:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787135879.766881:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0410dc70-43f2-4e7e-8b1a-609a240ccdf4 00000100:00100000:3.0:1787135880.157234:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616389760:0@lo:400:kworker.0 00000100:00100000:3.0:1787135880.157310:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135880.157369:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787135880.157375:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616389632:0@lo:400:kworker.0 00000100:00100000:3.0:1787135880.157405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135880.157433:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616389760 00000100:00100000:3.0:1787135880.157441:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616389760 00000100:00100000:3.0:1787135880.157488:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787135880.157497:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616389760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135880.157541:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616389760:12345-0@lo:400:kworker.0 Request processed in 45us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135880.157548:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787135880.157568:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616389632 00000100:00100000:3.0:1787135880.157571:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616389632 00000100:00100000:3.0:1787135880.157596:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787135880.157602:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616389632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135880.157649:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616389632:12345-0@lo:400:kworker.0 Request processed in 46us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135880.157655:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1787135880.157677:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787135880.157681:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787135880.157711:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616389632:0@lo:400:kworker.0 00010000:00080000:3.0:1787135880.157723:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d8a80 x1873947616389760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135880.157733:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616389760:0@lo:400:kworker.0 00000100:00100000:0.0:1787135880.157869:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616389376:0@lo:400:kworker.0 00000100:00100000:0.0:1787135880.157901:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135880.157931:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616389888:0@lo:400:kworker.0 00000100:00100000:0.0:1787135880.157952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135880.157970:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787135880.157976:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616389504:0@lo:400:kworker.0 00000100:00100000:0.0:1787135880.157994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135880.158007:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616390016:0@lo:400:kworker.0 00000100:00100000:0.0:1787135880.158025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135880.158069:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616389888 00000100:00100000:0.0:1787135880.158074:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616389888 00000100:00100000:0.0:1787135880.158098:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616389504 00000100:00100000:0.0:1787135880.158101:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616389504 00000100:00100000:0.0:1787135880.158116:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787135880.158122:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616389888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135880.158156:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616389888:12345-0@lo:400:kworker.0 Request processed in 33us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135880.158163:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787135880.158175:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787135880.158182:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616389504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135880.158207:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616389504:12345-0@lo:400:kworker.0 Request processed in 26us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135880.158213:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787135880.158227:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616390016 00000100:00100000:0.0:1787135880.158237:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616390016 00000100:00100000:0.0:1787135880.158260:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787135880.158267:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616390016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135880.158309:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616390016:12345-0@lo:400:kworker.0 Request processed in 42us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135880.158316:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787135880.158340:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616389504:0@lo:400:kworker.0 00010000:00080000:0.0:1787135880.158351:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d8380 x1873947616390016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135880.158360:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616390016:0@lo:400:kworker.0 00000100:00100000:0.0:1787135880.158369:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616389888:0@lo:400:kworker.0 00000100:00100000:3.0:1787135880.158593:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616389376 00000100:00100000:3.0:1787135880.158598:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616389376 00000100:00100000:3.0:1787135880.158631:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1787135880.158638:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616389376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135880.158682:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616389376:12345-0@lo:400:kworker.0 Request processed in 45us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135880.158688:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:3.0:1787135880.158717:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787135880.158721:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135880.158774:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616389376:0@lo:400:kworker.0 00010000:00010000:1.0:1787135880.281401:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135880.670477:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787135880.670501:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616390144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135880.670567:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135880.670659:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616390144 00000100:00100000:1.0:1787135880.670674:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616390144 00000100:00100000:1.0:1787135880.670722:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787135880.670731:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616390144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787135880.670761:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135880.670811:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616390144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135880.670820:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787135880.670865:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987c0a5180 x1873947616390144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135880.670883:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616390144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787135880.671726:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616390272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787135880.671766:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135880.672106:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616390272 00000100:00100000:0.0:1787135880.672113:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616390272 00000100:00100000:0.0:1787135880.672148:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787135880.672156:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616390272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787135880.672183:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135880.672219:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616390272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135880.672226:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1787135880.677990:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987c0a5180 x1873947616390272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135880.678019:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616390272:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787135880.690989:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0410dc70-43f2-4e7e-8b1a-609a240ccdf4 00000001:00100000:2.0:1787135881.220372:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0410dc70-43f2-4e7e-8b1a-609a240ccdf4 00010000:00010000:2.0:1787135881.304300:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135882.331850:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135883.352942:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787135884.132717:0:10298:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1787135884.138739:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135884.138787:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135884.138808:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135884.138838:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135884.138858:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135884.138894:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595386752 00000100:00100000:2.0:1787135884.138903:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595386752 00000100:00100000:2.0:1787135884.138950:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595386624 00000100:00100000:2.0:1787135884.138953:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595386624 00000100:00100000:2.0:1787135884.138970:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:2.0:1787135884.138979:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2361:x1873947595386752:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135884.139064:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2361:x1873947595386752:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135884.139086:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:2.0:1787135884.139103:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:2.0:1787135884.139110:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2361:x1873947595386624:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135884.139138:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2361:x1873947595386624:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135884.139144:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:3.0:1787135884.139460:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595386240 00000100:00100000:3.0:1787135884.139465:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595386240 00000100:00100000:3.0:1787135884.139507:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 218 00000100:00100000:3.0:1787135884.139526:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2361:x1873947595386240:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135884.139567:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2361:x1873947595386240:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 53us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135884.139575:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 218 00000100:00100000:3.0:1787135884.139608:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595386496 00000100:00100000:3.0:1787135884.139611:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595386496 00000100:00100000:3.0:1787135884.139636:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595386368 00000100:00100000:3.0:1787135884.139638:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595386368 00000100:00100000:3.0:1787135884.139658:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:3.0:1787135884.139663:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2361:x1873947595386496:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135884.139690:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2361:x1873947595386496:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135884.139697:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:3.0:1787135884.139709:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:3.0:1787135884.139715:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595386368:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135884.139739:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595386368:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135884.139745:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00080000:3.0:1787135884.139760:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787135884.139764:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787135884.139766:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787135884.376408:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135885.273651:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616390400:0@lo:400:kworker.0 00000100:00100000:2.0:1787135885.273729:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135885.273792:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616390400 00000100:00100000:1.0:1787135885.273800:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616390400 00000100:00100000:1.0:1787135885.273867:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787135885.273877:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616390400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135885.273909:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787135885.273918:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616390528:0@lo:400:kworker.0 00000100:00100000:1.0:1787135885.273957:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616390400:12345-0@lo:400:kworker.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135885.273961:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135885.273970:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787135885.274224:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616390400:0@lo:400:kworker.0 00000100:00100000:2.0:1787135885.274255:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616390528 00000100:00100000:2.0:1787135885.274370:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616390528 00000100:00100000:2.0:1787135885.274417:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787135885.274426:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616390528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135885.274470:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616390528:12345-0@lo:400:kworker.0 Request processed in 46us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135885.274478:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787135885.274630:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616390528:0@lo:400:kworker.0 00000100:00100000:0.0:1787135885.276671:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616390656:0@lo:400:kworker.0 00000100:00100000:3.0:1787135885.276743:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616390784:0@lo:400:kworker.0 00000100:00100000:3.0:1787135885.276795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135885.276904:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616391040:0@lo:400:kworker.0 00000100:00100000:2.0:1787135885.276934:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135885.276962:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787135885.276976:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616390912:0@lo:400:kworker.0 00000100:00100000:0.0:1787135885.277076:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135885.277239:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135885.277385:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616390656 00000100:00100000:2.0:1787135885.277413:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616390784 00000100:00100000:2.0:1787135885.277420:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616390784 00000100:00100000:2.0:1787135885.277469:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616391040 00000100:00100000:2.0:1787135885.277472:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616391040 00000100:00100000:2.0:1787135885.277492:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787135885.277500:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616390784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135885.277648:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616390656 00000100:00100000:2.0:1787135885.277697:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616390784:12345-0@lo:400:kworker.0 Request processed in 197us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135885.277705:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787135885.277722:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787135885.277729:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616391040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135885.277764:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616391040:12345-0@lo:400:kworker.0 Request processed in 36us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135885.277770:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787135885.277785:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787135885.277789:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787135885.277791:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787135885.277827:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738dbb80 x1873947616390784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135885.277841:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616390784:0@lo:400:kworker.0 00010000:00080000:2.0:1787135885.277872:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d9c00 x1873947616391040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135885.277882:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616391040:0@lo:400:kworker.0 00000100:00100000:0.0:1787135885.277885:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616390912 00000100:00100000:2.0:1787135885.277907:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787135885.277923:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616390656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135885.277964:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616390656:12345-0@lo:400:kworker.0 Request processed in 41us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135885.277970:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787135885.277997:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616390656:0@lo:400:kworker.0 00000100:00100000:0.0:1787135885.278082:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616390912 00000100:00100000:0.0:1787135885.278341:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787135885.278354:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616390912:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787135885.278363:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135885.278411:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616390912:12345-0@lo:400:kworker.0 Request processed in 61us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135885.278690:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616390912:0@lo:400:kworker.0 00000100:00100000:0.0:1787135885.281966:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:0.0:1787135885.402181:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135885.787143:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616391168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787135885.787215:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135885.787299:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616391168 00000100:00100000:1.0:1787135885.787307:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616391168 00000100:00100000:1.0:1787135885.787351:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787135885.787360:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616391168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787135885.787465:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135885.787575:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616391168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 216us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135885.787582:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787135885.787621:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987c0a6a00 x1873947616391168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135885.787639:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616391168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135885.789727:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616391296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135885.789787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135885.789820:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616391296 00000100:00100000:1.0:1787135885.789829:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616391296 00000100:00100000:1.0:1787135885.789873:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787135885.789884:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616391296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787135885.789915:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135885.789970:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616391296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135885.789978:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1787135885.791114:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738daa00 x1873947616391296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135885.791136:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616391296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787135886.425400:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135887.457018:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135888.473310:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135889.253195:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135889.253228:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135889.253259:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135889.253280:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135889.253314:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595387008 00000100:00100000:1.0:1787135889.253326:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595387008 00000100:00100000:2.0:1787135889.253331:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135889.253361:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595387264 00000100:00100000:2.0:1787135889.253366:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595387264 00000100:00100000:1.0:1787135889.253390:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595387136 00000100:00100000:1.0:1787135889.253395:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595387136 00000100:00100000:2.0:1787135889.253407:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595387392 00000100:00100000:2.0:1787135889.253412:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595387392 00000100:00100000:1.0:1787135889.253430:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:2.0:1787135889.253438:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:1.0:1787135889.253444:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595387008:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135889.253452:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595387264:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135889.253523:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595387008:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 83us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135889.253530:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:1.0:1787135889.253546:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:1.0:1787135889.253553:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595387136:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135889.253578:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595387136:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135889.253591:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00080000:1.0:1787135889.253609:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787135889.253613:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787135889.253615:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135889.253680:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595387264:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 233us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135889.253699:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:2.0:1787135889.253716:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:2.0:1787135889.253724:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595387392:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135889.253763:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595386880 00000100:00100000:2.0:1787135889.253765:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595387392:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 41us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135889.253770:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595386880 00000100:00100000:2.0:1787135889.253775:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1787135889.253815:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:1.0:1787135889.253823:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595386880:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135889.253863:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595386880:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 41us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135889.253870:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 220 00010000:00010000:2.0:1787135889.514752:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135890.392267:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616391680:0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.392349:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135890.392408:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787135890.392414:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616391808:0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.392445:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135890.392491:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616391680 00000100:00100000:3.0:1787135890.392498:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616391680 00000100:00100000:3.0:1787135890.392561:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787135890.392570:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616391680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.392621:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616391680:12345-0@lo:400:kworker.0 Request processed in 52us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135890.392629:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1787135890.392651:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135890.392679:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616391680:0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.392714:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616391552:0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.392736:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135890.392753:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616392064:0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.392771:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135890.392804:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787135890.392812:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616391424:0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.392844:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135890.392867:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616391936:0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.392888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135890.392912:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616391552 00000100:00100000:3.0:1787135890.392915:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616391552 00000100:00100000:3.0:1787135890.392935:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616391936 00000100:00100000:3.0:1787135890.392937:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616391936 00000100:00100000:3.0:1787135890.392967:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787135890.392972:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616391552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.393005:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616391552:12345-0@lo:400:kworker.0 Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135890.393011:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787135890.393022:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787135890.393042:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616391936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.393100:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616391936:12345-0@lo:400:kworker.0 Request processed in 72us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135890.393107:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787135890.393127:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616391424 00000100:00100000:3.0:1787135890.393131:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616391424 00000100:00100000:3.0:1787135890.393150:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787135890.393156:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616391424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.393184:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616391424:12345-0@lo:400:kworker.0 Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135890.393189:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:3.0:1787135890.393211:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135890.393229:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616391424:0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.393241:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616391936:0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.393249:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616391552:0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.393279:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616391808 00000100:00100000:3.0:1787135890.393282:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616391808 00000100:00100000:3.0:1787135890.393306:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616392064 00000100:00100000:3.0:1787135890.393308:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616392064 00000100:00100000:3.0:1787135890.393322:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787135890.393336:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616391808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.393374:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616391808:12345-0@lo:400:kworker.0 Request processed in 39us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135890.393380:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787135890.393523:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787135890.393531:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616392064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.393568:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616392064:12345-0@lo:400:kworker.0 Request processed in 38us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135890.393574:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787135890.393591:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787135890.393595:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787135890.393612:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d8000 x1873947616391808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1787135890.393617:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d9c00 x1873947616392064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135890.393633:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616391808:0@lo:400:kworker.0 00000100:00100000:3.0:1787135890.393637:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616392064:0@lo:400:kworker.0 00010000:00010000:0.0:1787135890.520436:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135890.904567:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787135890.904590:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616392192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787135890.904655:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135890.904713:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616392192 00000100:00100000:3.0:1787135890.904721:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616392192 00000100:00100000:3.0:1787135890.904764:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787135890.904783:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616392192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787135890.904813:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135890.904865:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616392192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135890.904872:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787135890.904913:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d9c00 x1873947616392192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135890.904937:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616392192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787135890.914744:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787135890.914765:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616392320:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787135890.915126:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135890.915182:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616392320 00000100:00100000:3.0:1787135890.915191:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616392320 00000100:00100000:3.0:1787135890.915646:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787135890.915657:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616392320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787135890.915692:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135890.924663:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616392320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8999us (9529us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135890.924679:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787135890.927841:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d9c00 x1873947616392320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135890.927871:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616392320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787135891.552869:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135892.568742:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135893.594132:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135894.382951:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135894.383003:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135894.383029:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135894.383074:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135894.383101:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135894.383128:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595387776 00000100:00100000:3.0:1787135894.383137:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595387776 00000100:00100000:3.0:1787135894.383185:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595387648 00000100:00100000:3.0:1787135894.383187:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595387648 00000100:00100000:3.0:1787135894.383220:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:3.0:1787135894.383229:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595387776:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135894.383298:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595387776:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 70us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135894.383305:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:3.0:1787135894.383321:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:3.0:1787135894.383327:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595387648:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135894.383348:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595387648:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135894.383353:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:3.0:1787135894.383368:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595388032 00000100:00100000:3.0:1787135894.383371:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595388032 00000100:00100000:3.0:1787135894.383393:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595387904 00000100:00100000:3.0:1787135894.383396:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595387904 00000100:00100000:3.0:1787135894.383408:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1787135894.383413:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595388032:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135894.383435:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595388032:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 22us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135894.383441:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1787135894.383451:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:3.0:1787135894.383457:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595387904:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135894.383475:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595387904:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 19us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135894.383481:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00080000:3.0:1787135894.383500:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787135894.383508:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787135894.383511:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135894.384211:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595387520 00000100:00100000:0.0:1787135894.384218:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595387520 00000100:00100000:0.0:1787135894.384261:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 222 00000100:00100000:0.0:1787135894.384269:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595387520:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135894.384310:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595387520:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 42us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135894.384317:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 222 00010000:00010000:0.0:1787135894.618226:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135895.513714:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616392576:0@lo:400:kworker.0 00000100:00100000:3.0:1787135895.513798:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135895.513863:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616393088:0@lo:400:kworker.0 00000100:00100000:3.0:1787135895.513890:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135895.513903:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616392576 00000100:00100000:0.0:1787135895.513912:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616392576 00000100:00100000:3.0:1787135895.513925:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787135895.513933:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616392448:0@lo:400:kworker.0 00000100:00100000:3.0:1787135895.513967:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135895.513969:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787135895.513983:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616392576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135895.513995:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616392960:0@lo:400:kworker.0 00000100:00100000:3.0:1787135895.514015:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135895.514067:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616392704:0@lo:400:kworker.0 00000100:00100000:0.0:1787135895.514102:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616392576:12345-0@lo:400:kworker.0 Request processed in 122us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135895.514120:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787135895.514139:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616392960 00000100:00100000:0.0:1787135895.514143:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616392960 00000100:00100000:1.0:1787135895.514149:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616392832:0@lo:400:kworker.0 00000100:00100000:0.0:1787135895.514185:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787135895.514194:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616392960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135895.517211:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135895.517268:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616393088 00000100:00100000:3.0:1787135895.517276:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616393088 00000100:00100000:3.0:1787135895.517323:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787135895.517333:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616393088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135895.517384:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616393088:12345-0@lo:400:kworker.0 Request processed in 54us (3494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135895.517392:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787135895.517416:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616392704 00000100:00100000:3.0:1787135895.517419:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616392704 00000100:00100000:3.0:1787135895.517438:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787135895.517445:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616392704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135895.517479:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874829180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616392704:12345-0@lo:400:kworker.0 Request processed in 35us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135895.517494:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787135895.517512:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616392448 00000100:00100000:3.0:1787135895.517516:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616392448 00000100:00100000:3.0:1787135895.517542:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1787135895.517548:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616392448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135895.517579:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616392448:12345-0@lo:400:kworker.0 Request processed in 32us (3614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135895.517586:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:3.0:1787135895.517615:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787135895.517619:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135895.517656:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616392704:0@lo:400:kworker.0 00000100:00100000:3.0:1787135895.517687:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616392448:0@lo:400:kworker.0 00000100:00100000:3.0:1787135895.517699:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616392576:0@lo:400:kworker.0 00010000:00080000:3.0:1787135895.517711:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d8000 x1873947616393088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135895.517721:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616393088:0@lo:400:kworker.0 00000100:00100000:1.0:1787135895.521240:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135895.522075:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616392832 00000100:00100000:1.0:1787135895.522085:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616392832 00000100:00100000:1.0:1787135895.522152:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1787135895.522158:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787135895.522163:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616392832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135895.522234:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616392832:12345-0@lo:400:kworker.0 Request processed in 73us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135895.522241:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787135895.522251:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d8380 x1873947616392832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135895.522265:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616392832:0@lo:400:kworker.0 00000100:00100000:0.0:1787135895.528855:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616392960:12345-0@lo:400:kworker.0 Request processed in 14655us (14830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135895.528870:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787135895.531807:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616392960:0@lo:400:kworker.0 00010000:00010000:2.0:1787135895.642124:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135896.026712:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787135896.026743:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616393216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787135896.026837:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135896.026917:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616393216 00000100:00100000:2.0:1787135896.026926:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616393216 00000100:00100000:2.0:1787135896.026968:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787135896.026977:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987482b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616393216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787135896.027011:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135896.027071:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987482b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616393216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135896.027079:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787135896.027096:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787135896.027104:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616393344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135896.027129:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135896.027176:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616393344 00000100:00100000:2.0:1787135896.027180:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616393344 00000100:00100000:2.0:1787135896.027203:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787135896.027210:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616393344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787135896.027228:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135896.027279:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616393344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135896.027286:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1787135896.027322:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9874828700 x1873947616393216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135896.027339:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616393216:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787135896.028111:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd3800 x1873947616393344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135912 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135896.028129:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616393344:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787135896.667237:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135897.690191:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135898.712215:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135899.498337:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135899.498367:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135899.498392:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135899.498420:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135899.498446:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135899.498477:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595388416 00000100:00100000:0.0:1787135899.498487:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595388416 00000100:00100000:0.0:1787135899.499519:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595388288 00000100:00100000:0.0:1787135899.499527:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595388288 00000100:00100000:0.0:1787135899.499695:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:0.0:1787135899.499708:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595388416:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135899.500132:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595388416:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 427us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135899.500149:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:0.0:1787135899.500168:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:0.0:1787135899.500175:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595388288:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135899.500203:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595388288:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135899.500209:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:0.0:1787135899.500235:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595388544 00000100:00100000:0.0:1787135899.500239:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595388544 00000100:00100000:0.0:1787135899.500265:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595388672 00000100:00100000:0.0:1787135899.500268:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595388672 00000100:00100000:0.0:1787135899.500281:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:0.0:1787135899.500287:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2358:x1873947595388544:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:0.0:1787135899.500305:0:6672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202482 00000100:00080000:0.0:1787135899.500314:0:6672:0:(import.c:65:import_set_state_nolock()) ffff8e9852e59800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787135899.500349:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787135899.502121:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+2:2358:x1873947595388544:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 1824us (3691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135899.502134:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:0.0:1787135899.502157:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:0.0:1787135899.502167:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2358:x1873947595388672:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:0.0:1787135899.502186:0:6672:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202489 00000100:00080000:0.0:1787135899.502195:0:6672:0:(import.c:65:import_set_state_nolock()) ffff8e9852e58000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787135899.502229:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787135899.502413:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+2:2358:x1873947595388672:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 248us (3965us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135899.502446:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00080000:0.0:1787135899.502475:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787135899.502479:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787135899.502483:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787135899.502611:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135899.502628:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135899.503344:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595388160 00000100:00100000:3.0:1787135899.503354:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595388160 00000100:00100000:3.0:1787135899.503400:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 224 00000100:00100000:3.0:1787135899.503918:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595388160:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135899.503976:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595388160:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 568us (5648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135899.503984:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 224 00010000:00010000:0.0:1787135899.741558:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787135899.877686:0:11000:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1787135900.172571:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0410dc70-43f2-4e7e-8b1a-609a240ccdf4 00000020:00000080:3.0:1787135900.172580:0:7625:0:(genops.c:906:class_export_put()) final put ffff8e9852e5f000/0410dc70-43f2-4e7e-8b1a-609a240ccdf4 00000020:00000080:2.0:1787135900.172661:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9852e5f000/0410dc70-43f2-4e7e-8b1a-609a240ccdf4 for lustre-OST0001 00000020:00000080:2.0:1787135900.172720:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9852e58000 for lustre-OST0001 00000100:00100000:3.0:1787135900.632350:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616393856:0@lo:400:kworker.0 00000100:00100000:0.0:1787135900.632350:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616393600:0@lo:400:kworker.0 00000100:00100000:1.0:1787135900.632442:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987482a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616393472:0@lo:400:kworker.0 00000100:00100000:0.0:1787135900.633724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135900.633787:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616394112:0@lo:400:kworker.0 00000100:00100000:0.0:1787135900.633835:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135900.633886:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616393728:0@lo:400:kworker.0 00000100:00100000:0.0:1787135900.633921:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135900.633958:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616393600 00000100:00100000:0.0:1787135900.633966:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616393600 00000100:00100000:0.0:1787135900.634012:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616393728 00000100:00100000:0.0:1787135900.634016:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616393728 00000100:00100000:0.0:1787135900.634066:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787135900.634076:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616393600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135900.634130:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616393600:12345-0@lo:400:kworker.0 Request processed in 55us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135900.634138:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1787135900.634155:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787135900.634162:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616393728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135900.634196:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616393728:12345-0@lo:400:kworker.0 Request processed in 35us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135900.634202:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1787135900.634227:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616394112 00000100:00100000:0.0:1787135900.634231:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616394112 00000100:00100000:0.0:1787135900.634256:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787135900.634263:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616394112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135900.634292:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874496680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616394112:12345-0@lo:400:kworker.0 Request processed in 29us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135900.634298:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787135900.634317:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787135900.634322:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135900.634351:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616393728:0@lo:400:kworker.0 00000100:00100000:0.0:1787135900.634386:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874828700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616393600:0@lo:400:kworker.0 00010000:00080000:0.0:1787135900.634397:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d9f80 x1873947616394112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135900.634407:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616394112:0@lo:400:kworker.0 00000100:00100000:3.0:1787135900.636501:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135900.636659:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616393856 00000100:00100000:2.0:1787135900.636667:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616393856 00000100:00100000:2.0:1787135900.636766:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787135900.636893:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616393856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135900.636965:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616393856:12345-0@lo:400:kworker.0 Request processed in 76us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135900.636973:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1787135900.637026:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d8380 x1873947616393856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135900.637040:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616393856:0@lo:400:kworker.0 00000100:00080000:3.0:1787135900.637757:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787135900.639681:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135900.639758:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616393984:0@lo:400:kworker.0 00000100:00100000:1.0:1787135900.639801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135900.639848:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616393984 00000100:00100000:1.0:1787135900.639855:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616393984 00000100:00100000:1.0:1787135900.639906:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787135900.639914:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616393984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135900.639966:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616393984:12345-0@lo:400:kworker.0 Request processed in 53us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135900.639974:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1787135900.639998:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135900.640025:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616393984:0@lo:400:kworker.0 00000100:00100000:0.0:1787135900.640776:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616393472 00000100:00100000:0.0:1787135900.640783:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616393472 00000100:00100000:0.0:1787135900.641892:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787135900.641908:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616393472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135900.642065:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616393472:12345-0@lo:400:kworker.0 Request processed in 147us (2372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135900.642073:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1787135900.642195:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987482a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616393472:0@lo:400:kworker.0 00010000:00010000:2.0:1787135900.763959:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135901.146915:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787135901.146937:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616394240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787135901.147007:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135901.147083:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616394240 00000100:00100000:1.0:1787135901.147091:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616394240 00000100:00100000:1.0:1787135901.147135:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787135901.147143:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616394240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787135901.147174:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135901.147214:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616394240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135901.147221:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1787135901.147259:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987c0a7100 x1873947616394240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135901.147286:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616394240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787135901.150630:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616394368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787135901.150713:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135901.150774:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616394368 00000100:00100000:3.0:1787135901.150780:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616394368 00000100:00100000:3.0:1787135901.150824:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787135901.150832:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616394368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787135901.150863:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135901.150902:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616394368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135901.150910:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1787135901.150946:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d9880 x1873947616394368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135901.150963:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616394368:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1787135901.753770:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0410dc70-43f2-4e7e-8b1a-609a240ccdf4 00000020:00000080:2.0:1787135901.753781:0:6697:0:(genops.c:906:class_export_put()) final put ffff8e9852e5f800/0410dc70-43f2-4e7e-8b1a-609a240ccdf4 00000020:00000080:1.0:1787135901.758328:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9852e5f800/0410dc70-43f2-4e7e-8b1a-609a240ccdf4 for lustre-OST0000 00000020:00000080:2.0:1787135901.758827:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9852e59800 for lustre-OST0000 00010000:00010000:3.0:1787135901.785139:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135902.812809:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787135903.124672:0:11149:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcfd8ae4e0 20000000:00000080:1.0:1787135903.124697:0:11149:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e9881f88800 uarg=0000000000000000 20000000:01000000:1.0:1787135903.124729:0:11149:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787135903.124735:0:11149:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787135903.124739:0:11149:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787135903.125697:0:11150:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787135903.125834:0:11149:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787135903.133024:0:11149:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787135903.133238:0:11149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.133260:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841489000/0xf5850c552f202435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718143 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.133270:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98511dac00/0xf5850c552f202443 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20243c expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.133277:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841489c00/0xf5850c552f202451 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20244a expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.133284:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e987c2c7400/0xf5850c552f20245f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202458 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.133291:0:11149:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98511da200/0xf5850c552f202474 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71817b expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.133298:0:11149:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.133341:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98511da200/0xf5850c552f202474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71817b expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.133356:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e98511da200/0xf5850c552f202474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71817b expref: 12 pid: 5815 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135903.133371:0:11149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1873947616394496:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135903.133535:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e987c2c7400/0xf5850c552f20245f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f202458 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.133555:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e987c2c7400/0xf5850c552f20245f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f202458 expref: 18 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135903.133565:0:11149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1873947616394624:0@lo:104: 00000100:00100000:2.0:1787135903.133604:0:11149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135903.133633:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616394624 00000100:00100000:2.0:1787135903.133640:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616394624 00000100:00100000:2.0:1787135903.133683:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787135903.134698:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:11149:x1873947616394624:12345-0@lo:104: 00010000:00010000:2.0:1787135903.134715:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20245f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.134773:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135903.134779:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:11149:x1873947616394624:12345-0@lo:104: Request processed in 1090us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135903.134786:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1787135903.134825:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841489c00/0xf5850c552f202451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f20244a expref: 18 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.134836:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9841489c00/0xf5850c552f202451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f20244a expref: 18 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135903.134846:0:11149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1873947616394752:0@lo:104: 00000100:00100000:2.0:1787135903.134869:0:11149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135903.134889:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616394752 00000100:00100000:2.0:1787135903.134894:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616394752 00000100:00100000:2.0:1787135903.134910:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787135903.134915:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:11149:x1873947616394752:12345-0@lo:104: 00010000:00010000:2.0:1787135903.134930:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202451 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.134967:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787135903.134972:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:11149:x1873947616394752:12345-0@lo:104: Request processed in 57us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135903.134978:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787135903.134992:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787135903.134997:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20245f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135004:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841489e00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135903.135008:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f20245f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135017:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f20245f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135903.135024:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f20245f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135903.135175:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787135903.135204:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20245f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135210:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135903.135227:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20245f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135234:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9841489e00/0xf5850c552f202458 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20245f expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135251:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135903.135255:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202451 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135261:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7a00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135903.135264:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202451 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135271:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202451 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135903.135278:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202451 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135903.135283:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787135903.135294:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202451 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135299:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135903.135304:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202451 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135310:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7a00/0xf5850c552f20244a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202451 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135318:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135903.135319:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135903.135321:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135903.135336:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98511dac00/0xf5850c552f202443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f20243c expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135349:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e98511dac00/0xf5850c552f202443 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f20243c expref: 18 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135903.135358:0:11149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1873947616395136:0@lo:104: 00000100:00100000:2.0:1787135903.135380:0:11149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135903.135397:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616395136 00000100:00100000:2.0:1787135903.135400:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616395136 00000100:00100000:2.0:1787135903.135414:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787135903.135419:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:11149:x1873947616395136:12345-0@lo:104: 00010000:00010000:2.0:1787135903.135426:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202443 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135451:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135903.135456:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:11149:x1873947616395136:12345-0@lo:104: Request processed in 37us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135903.135461:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787135903.135472:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135903.135475:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f202443 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135481:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840030a00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135903.135485:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f202443 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135491:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f202443 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135903.135497:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f202443 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135903.135507:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787135903.135519:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202443 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135525:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135903.135538:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202443 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135545:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840030a00/0xf5850c552f20243c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f202443 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135558:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135903.135559:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135903.135560:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135903.135576:0:11149:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841489000/0xf5850c552f202435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718143 expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.135584:0:11149:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e9841489000/0xf5850c552f202435 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718143 expref: 12 pid: 5813 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135903.135594:0:11149:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1873947616395392:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135903.135628:0:11149:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f6cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787135903.135646:0:11149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533a9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1873947616394624:0@lo:104: 00000100:00100000:2.0:1787135903.135653:0:11149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533ab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1873947616394752:0@lo:104: 00000100:00100000:2.0:1787135903.135658:0:11149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533aad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1873947616395136:0@lo:104: 00000100:00100000:1.0:1787135903.135969:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616394880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787135903.135999:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135903.136026:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787135903.136387:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616395008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787135903.136411:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135903.136448:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616394880 00000100:00100000:1.0:1787135903.136453:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616394880 00010000:00010000:1.0:1787135903.136473:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e987c2c7400/0xf5850c552f20245f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202458 expref: 19 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135903.136492:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616395008 00000100:00100000:1.0:1787135903.136495:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616395008 00010000:00010000:1.0:1787135903.136503:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841489c00/0xf5850c552f202451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20244a expref: 20 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135903.136523:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787135903.136529:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+20:3300:x1873947616394880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787135903.136539:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135903.136544:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e987c2c7400/0xf5850c552f20245f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f202458 expref: 20 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135903.136565:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e987c2c7400/0xf5850c552f20245f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f202458 expref: 20 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135903.136579:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e987c2c7400/0xf5850c552f20245f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f202458 expref: 20 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135903.136591:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135903.136616:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457c9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616394880:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135903.136622:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787135903.136658:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787135903.136664:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+18:3300:x1873947616395008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787135903.136670:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135903.136674:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841489c00/0xf5850c552f202451 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20244a expref: 18 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135903.136682:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841489c00/0xf5850c552f202451 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f20244a expref: 18 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135903.136707:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841489c00/0xf5850c552f202451 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f20244a expref: 18 pid: 5816 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135903.136716:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135903.136736:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+17:3300:x1873947616395008:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135903.136741:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787135903.136769:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616395008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787135903.136775:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616394880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787135903.138194:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616395264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787135903.138245:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787135903.138299:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135903.138344:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616395264 00000100:00100000:1.0:1787135903.138350:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616395264 00010000:00010000:1.0:1787135903.138376:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98511dac00/0xf5850c552f202443 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20243c expref: 17 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135903.138408:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787135903.138416:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874494700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+17:3302:x1873947616395264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787135903.138426:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135903.138432:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98511dac00/0xf5850c552f202443 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20243c expref: 17 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135903.138442:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98511dac00/0xf5850c552f202443 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f20243c expref: 17 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135903.138456:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511dac00/0xf5850c552f202443 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f20243c expref: 17 pid: 5815 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135903.138468:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135903.138508:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874494700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+16:3302:x1873947616395264:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135903.138514:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787135903.138599:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616395264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787135903.141194:0:11149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1873947616394496:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135903.141209:0:11149:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533a8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11149:1873947616395392:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135903.141256:0:11149:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135903.141855:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135903.142246:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135903.142326:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595388800 00000100:00100000:1.0:1787135903.142335:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595388800 00010000:00010000:1.0:1787135903.142386:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841489000/0xf5850c552f202435 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718143 expref: 13 pid: 5813 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135903.142437:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595388928 00000100:00100000:0.0:1787135903.142441:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595388928 00010000:00010000:0.0:1787135903.142458:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98511da200/0xf5850c552f202474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71817b expref: 14 pid: 5815 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135903.142489:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:0.0:1787135903.142500:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccb52158-7d35-4065-a26d-1bb142899404+14:2360:x1873947595388800:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135903.142518:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135903.142524:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841489000/0xf5850c552f202435 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718143 expref: 14 pid: 5813 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135903.142537:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841489000/0xf5850c552f202435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718143 expref: 14 pid: 5813 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135903.142555:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841489000/0xf5850c552f202435 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718143 expref: 14 pid: 5813 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135903.142571:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135903.142594:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:3.0:1787135903.142602:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595388928:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787135903.142610:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135903.142615:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98511da200/0xf5850c552f202474 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71817b expref: 13 pid: 5815 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135903.142627:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595388800:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 130us (775us total) trans 0 rc 0/0 00010000:00010000:3.0:1787135903.142630:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98511da200/0xf5850c552f202474 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71817b expref: 13 pid: 5815 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135903.142635:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00010000:00010000:3.0:1787135903.142640:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511da200/0xf5850c552f202474 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71817b expref: 13 pid: 5815 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135903.142651:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135903.142660:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135903.142679:0:7612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135903.142697:0:7612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135903.142705:0:7612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135903.142712:0:7612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135903.142730:0:7612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787135903.142734:0:7612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135903.142741:0:7612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135903.142762:0:7612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.142788:0:11149:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135903.142796:0:11149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135903.142825:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e987c2c6400/0xf5850c552f202490 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135903.142839:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135903.142861:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccb52158-7d35-4065-a26d-1bb142899404+11:2360:x1873947595388928:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 260us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135903.142866:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00010000:00010000:2.0:1787135903.835004:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135904.614784:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135904.614831:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135904.614915:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135904.614942:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595389184 00000100:00100000:0.0:1787135904.614951:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595389184 00000100:00100000:0.0:1787135904.614999:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595389312 00000100:00100000:0.0:1787135904.615001:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595389312 00000100:00100000:0.0:1787135904.615019:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:0.0:1787135904.615035:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595389184:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135904.615122:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595389184:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 88us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135904.615129:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:0.0:1787135904.615145:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:0.0:1787135904.615151:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595389312:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135904.615175:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595389312:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135904.615181:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00080000:1.0:1787135904.615357:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135904.619106:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595389056 00000100:00100000:2.0:1787135904.619121:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595389056 00000100:00100000:2.0:1787135904.619182:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 226 00000100:00100000:2.0:1787135904.619191:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+11:2359:x1873947595389056:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135904.619262:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+11:2359:x1873947595389056:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 72us (4430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135904.619270:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 226 00000100:00100000:3.0:1787135904.676889:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135904.676991:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595389440 00000100:00100000:1.0:1787135904.677000:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595389440 00000100:00100000:1.0:1787135904.677064:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 227 00000100:00100000:1.0:1787135904.677080:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+11:5600:x1873947595389440:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787135904.677096:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135904.677112:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9841489c00/0xf5850c552f202497 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181a5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135904.677138:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9841489c00/0xf5850c552f202497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181a5 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135904.677147:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9841489c00/0xf5850c552f202497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181a5 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135904.677156:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841489c00, rc 0) 00000100:00100000:1.0:1787135904.677205:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+12:5600:x1873947595389440:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 126us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135904.677211:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 227 00000100:00100000:1.0:1787135904.685137:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135904.688859:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595389568 00000100:00100000:3.0:1787135904.688873:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595389568 00000100:00100000:3.0:1787135904.688935:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 228 00000100:00100000:3.0:1787135904.688945:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+12:5600:x1873947595389568:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787135904.689305:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+12:5600:x1873947595389568:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 360us (4177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135904.689313:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 228 00000100:00100000:1.0:1787135904.691924:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135904.692003:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595389696 00000100:00100000:3.0:1787135904.692012:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595389696 00000100:00100000:3.0:1787135904.692083:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 229 00000100:00100000:3.0:1787135904.692092:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+12:5600:x1873947595389696:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787135904.692305:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+12:5600:x1873947595389696:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 213us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135904.692314:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 229 00000100:00100000:2.0:1787135904.696665:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135904.696940:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595389824 00000100:00100000:3.0:1787135904.696950:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595389824 00000100:00100000:3.0:1787135904.697002:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:3.0:1787135904.697011:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+12:5600:x1873947595389824:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787135904.697036:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135904.697071:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511da200/0xf5850c552f20249e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181ac expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135904.697098:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511da200/0xf5850c552f20249e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181ac expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135904.697107:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511da200/0xf5850c552f20249e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181ac expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135904.697116:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da200, rc 0) 00000100:00100000:3.0:1787135904.697170:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:5600:x1873947595389824:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 160us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135904.697177:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:2.0:1787135904.704759:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135904.704814:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595389952 00000100:00100000:1.0:1787135904.704825:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595389952 00000100:00100000:1.0:1787135904.704881:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 231 00000100:00100000:1.0:1787135904.704892:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:5600:x1873947595389952:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135904.705213:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:5600:x1873947595389952:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 322us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135904.705221:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 231 00000100:00100000:1.0:1787135904.713385:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135904.713510:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595390080 00000100:00100000:2.0:1787135904.713521:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595390080 00000100:00100000:2.0:1787135904.713571:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 232 00000100:00100000:2.0:1787135904.713581:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:5600:x1873947595390080:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787135904.713794:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:5600:x1873947595390080:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 214us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135904.713812:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 232 00010000:00010000:0.0:1787135904.856470:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787135905.176132:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787135905.176140:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e9744a91800 from 7 10000000:01000000:1.0:1787135905.176158:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787135905.176202:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135905.176215:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135905.176227:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135905.176253:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616395520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787135905.176317:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135905.176421:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aefd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787135905.180754:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616395520 00000100:00100000:0.0:1787135905.180768:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616395520 00000100:00100000:0.0:1787135905.180837:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1787135905.180847:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616395520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787135905.180863:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135905.180880:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9874896400/0xf5850c552f2024ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2024a5 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135905.180904:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9874896400/0xf5850c552f2024ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2024a5 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135905.180915:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9874896400/0xf5850c552f2024ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2024a5 expref: 17 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135905.180924:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896400, rc 0) 00000100:00100000:0.0:1787135905.181001:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616395520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (4684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135905.181019:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787135905.189440:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616395520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787135905.189470:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2024ac expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135905.189502:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2024ac expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135905.189584:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616395648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787135905.189640:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135905.189693:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9851155e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787135905.189715:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616395648 00000100:00100000:0.0:1787135905.189723:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616395648 00000100:00100000:0.0:1787135905.189774:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787135905.189783:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616395648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787135905.190037:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616395648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135905.190045:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1787135905.190108:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616395648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787135905.190144:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874495c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616395776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787135905.190183:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135905.190210:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9852b19c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787135905.191946:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616395776 00000100:00100000:2.0:1787135905.191958:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616395776 00000100:00100000:2.0:1787135905.192007:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1787135905.192016:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616395776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787135905.192254:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616395776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 238us (2068us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135905.192262:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1787135905.192287:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874495c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616395776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787135905.196631:0:11248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787135905.197010:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787135905.197034:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787135905.197045:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2024ac expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135905.197076:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2024ac expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135905.197087:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787135905.197091:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e98735aa000 from 7 10000000:01000000:0.0:1787135905.197093:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787135905.197129:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135905.197149:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135905.197159:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135905.197181:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874495c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616395904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787135905.197304:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135905.197345:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98525e5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787135905.197403:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616395904 00000100:00100000:3.0:1787135905.197410:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616395904 00000100:00100000:3.0:1787135905.197456:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787135905.197465:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616395904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787135905.197478:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135905.197491:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511da400/0xf5850c552f2024ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2024b3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135905.197511:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511da400/0xf5850c552f2024ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2024b3 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135905.197522:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511da400/0xf5850c552f2024ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2024b3 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135905.197530:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da400, rc 0) 00000100:00100000:3.0:1787135905.197579:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616395904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135905.197586:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787135905.197667:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874495c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616395904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787135905.197691:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2024ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135905.197701:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2024ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135905.197746:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616396032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135905.197771:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135905.197793:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aef6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135905.197839:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616396032 00000100:00100000:3.0:1787135905.197843:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616396032 00000100:00100000:3.0:1787135905.197871:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787135905.197885:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616396032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787135905.198149:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616396032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135905.198157:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787135905.198236:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616396032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135905.198263:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616396160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787135905.198301:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135905.198328:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aef6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135905.198375:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616396160 00000100:00100000:3.0:1787135905.198380:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616396160 00000100:00100000:3.0:1787135905.198404:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787135905.198410:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616396160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787135905.198554:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616396160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135905.198562:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787135905.198633:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616396160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787135905.200152:0:11249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1787135905.200568:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1787135905.200587:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787135905.200597:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2024ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135905.200608:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2024ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135905.200616:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787135905.200618:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e98456a5800 from 7 10000000:01000000:0.0:1787135905.200621:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787135905.200651:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135905.200659:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135905.200668:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135905.200714:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874495180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616396288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787135905.200767:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135905.200807:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98525e5300 going to sleep for 11 seconds 00000100:00100000:3.0:1787135905.200957:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616396288 00000100:00100000:3.0:1787135905.200964:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616396288 00000100:00100000:3.0:1787135905.201006:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787135905.201015:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616396288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787135905.201026:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135905.201039:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511db400/0xf5850c552f2024c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2024c1 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135905.201085:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511db400/0xf5850c552f2024c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2024c1 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135905.201096:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511db400/0xf5850c552f2024c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2024c1 expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135905.201104:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db400, rc 0) 00000100:00100000:3.0:1787135905.201141:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616396288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135905.201154:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787135905.201231:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874495180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616396288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787135905.201245:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2024c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135905.201253:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2024c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135905.201302:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616396416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135905.201396:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135905.201423:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f6c000 going to sleep for 11 seconds 00000100:00100000:0.0:1787135905.201474:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616396416 00000100:00100000:0.0:1787135905.201478:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616396416 00000100:00100000:0.0:1787135905.201507:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787135905.201514:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616396416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787135905.201735:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616396416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 221us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135905.201743:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1787135905.201772:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533aad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616396416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787135905.201800:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874496a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616396544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787135905.201834:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135905.201847:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98525e5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787135905.201858:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616396544 00000100:00100000:0.0:1787135905.201862:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616396544 00000100:00100000:0.0:1787135905.201877:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787135905.201883:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616396544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787135905.202009:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616396544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 125us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135905.202017:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1787135905.202076:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874496a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616396544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787135905.211453:0:11250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1787135905.213746:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1787135905.213786:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787135905.213797:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2024c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135905.213811:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2024c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135905.752243:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616396800:0@lo:400:kworker.0 00000100:00100000:3.0:1787135905.752310:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135905.752357:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787135905.752363:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616396928:0@lo:400:kworker.0 00000100:00100000:3.0:1787135905.752396:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135905.752432:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616396928 00000100:00100000:3.0:1787135905.752439:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616396928 00000100:00100000:3.0:1787135905.752486:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787135905.752494:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616396928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135905.752563:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616396928:12345-0@lo:400:kworker.0 Request processed in 69us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135905.752570:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1787135905.752590:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787135905.752624:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d8e00 x1873947616396928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135905.752636:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616396928:0@lo:400:kworker.0 00000100:00100000:1.0:1787135905.753005:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616397056:0@lo:400:kworker.0 00000100:00100000:1.0:1787135905.753038:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135905.753079:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787135905.753084:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616396672:0@lo:400:kworker.0 00000100:00100000:1.0:1787135905.753107:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135905.753122:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616397184:0@lo:400:kworker.0 00000100:00100000:1.0:1787135905.753140:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135905.753186:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616396800 00000100:00100000:1.0:1787135905.753191:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616396800 00000100:00100000:1.0:1787135905.753223:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616397056 00000100:00100000:1.0:1787135905.753226:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616397056 00000100:00100000:1.0:1787135905.753240:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616396672 00000100:00100000:1.0:1787135905.753242:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616396672 00000100:00100000:1.0:1787135905.753252:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787135905.753258:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616396800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135905.753295:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616396800:12345-0@lo:400:kworker.0 Request processed in 36us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135905.753301:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787135905.753316:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787135905.753322:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616397056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135905.753352:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616397056:12345-0@lo:400:kworker.0 Request processed in 31us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135905.753358:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787135905.753367:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787135905.753373:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616396672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135905.753432:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616396672:12345-0@lo:400:kworker.0 Request processed in 59us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135905.753439:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787135905.753459:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616397184 00000100:00100000:1.0:1787135905.753462:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616397184 00000100:00100000:1.0:1787135905.753484:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787135905.753491:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616397184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135905.753716:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616397184:12345-0@lo:400:kworker.0 Request processed in 46us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135905.753724:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787135905.753765:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616396672:0@lo:400:kworker.0 00010000:00080000:1.0:1787135905.753781:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9881fc3100 x1873947616397184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135905.753791:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616397184:0@lo:400:kworker.0 00000100:00100000:1.0:1787135905.753802:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616397056:0@lo:400:kworker.0 00000100:00080000:3.0:1787135905.753947:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787135905.753952:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135905.754253:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616396800:0@lo:400:kworker.0 00010000:00010000:0.0:1787135905.880430:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135906.265210:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787135906.265242:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616397312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135906.265301:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135906.265625:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616397312 00000100:00100000:1.0:1787135906.265633:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616397312 00000100:00100000:1.0:1787135906.265685:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787135906.265694:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616397312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787135906.265724:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135906.265766:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616397312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135906.265772:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787135906.265818:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98533ab480 x1873947616397312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135906.265858:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616397312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135906.272319:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787135906.272340:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616397440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135906.272410:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135906.272525:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616397440 00000100:00100000:2.0:1787135906.272595:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616397440 00000100:00100000:2.0:1787135906.272638:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787135906.272645:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616397440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787135906.272689:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135906.272729:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616397440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135906.272736:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1787135906.272770:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98533abb80 x1873947616397440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135906.272787:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616397440:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787135906.910877:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787135907.207653:0:11348:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787135907.928374:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135908.959956:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135909.734512:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135909.736660:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135909.736685:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135909.737854:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595390464 00000100:00100000:1.0:1787135909.737868:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595390464 00000100:00100000:1.0:1787135909.737932:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595390336 00000100:00100000:1.0:1787135909.737935:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595390336 00000100:00100000:1.0:1787135909.737965:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:1.0:1787135909.737976:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2362:x1873947595390464:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135909.738071:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2362:x1873947595390464:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 75us (1408us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135909.738079:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00080000:3.0:1787135909.738082:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135909.738097:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:1.0:1787135909.738103:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2362:x1873947595390336:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135909.738129:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2362:x1873947595390336:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135909.738136:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:0.0:1787135909.748377:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595390208 00000100:00100000:0.0:1787135909.748392:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595390208 00000100:00100000:0.0:1787135909.748465:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 242 00000100:00100000:0.0:1787135909.748809:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2362:x1873947595390208:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135909.749178:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2362:x1873947595390208:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 702us (14673us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135909.749188:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 242 00010000:00010000:0.0:1787135909.978474:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135910.877143:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616397824:0@lo:400:kworker.0 00000100:00100000:2.0:1787135910.877216:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135910.877259:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616397824 00000100:00100000:1.0:1787135910.877267:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616397824 00000100:00100000:2.0:1787135910.877284:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787135910.877292:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616397952:0@lo:400:kworker.0 00000100:00100000:2.0:1787135910.877319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135910.877372:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616397952 00000100:00100000:2.0:1787135910.877376:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616397952 00000100:00100000:1.0:1787135910.877452:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787135910.877457:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616397696:0@lo:400:kworker.0 00000100:00100000:1.0:1787135910.877467:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616397824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135910.877492:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135910.877552:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616397568:0@lo:400:kworker.0 00000100:00100000:0.0:1787135910.884080:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616398208:0@lo:400:kworker.0 00000100:00100000:1.0:1787135910.884141:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616397824:12345-0@lo:400:kworker.0 Request processed in 6676us (6922us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135910.884153:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787135910.884184:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616397696 00000100:00100000:1.0:1787135910.884191:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616397696 00000100:00100000:2.0:1787135910.884217:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787135910.884229:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616397952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135910.884276:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787135910.884287:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616397952:12345-0@lo:400:kworker.0 Request processed in 60us (6966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135910.884303:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1787135910.884361:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd1500 x1873947616397952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135910.884375:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616397952:0@lo:400:kworker.0 00000100:00100000:2.0:1787135910.884389:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616397824:0@lo:400:kworker.0 00000100:00100000:1.0:1787135910.884484:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616397696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135910.884517:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616397696:12345-0@lo:400:kworker.0 Request processed in 37us (7026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135910.884522:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1787135910.884539:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787135910.884544:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135910.888869:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135910.888948:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616398080:0@lo:400:kworker.0 00000100:00100000:3.0:1787135910.888991:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135910.889247:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616398080 00000100:00100000:2.0:1787135910.889251:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616397568 00000100:00100000:1.0:1787135910.889256:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616398080 00000100:00100000:2.0:1787135910.889258:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616397568 00000100:00100000:2.0:1787135910.889306:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787135910.889318:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616397568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135910.889323:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1787135910.889333:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616398080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135910.889392:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616398080:12345-0@lo:400:kworker.0 Request processed in 61us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135910.889398:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616397568:12345-0@lo:400:kworker.0 Request processed in 82us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135910.889403:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787135910.889412:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1787135910.891076:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135910.891132:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616397568:0@lo:400:kworker.0 00000100:00100000:3.0:1787135910.891150:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616398080:0@lo:400:kworker.0 00000100:00100000:0.0:1787135910.892474:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135910.892544:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616397696:0@lo:400:kworker.0 00000100:00100000:3.0:1787135910.893444:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616398208 00000100:00100000:3.0:1787135910.893457:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616398208 00000100:00100000:3.0:1787135910.893527:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787135910.893536:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616398208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135910.893602:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616398208:12345-0@lo:400:kworker.0 Request processed in 67us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135910.893608:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787135910.893709:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787135910.894128:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd2680 x1873947616398208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135910.894142:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616398208:0@lo:400:kworker.0 00010000:00010000:2.0:1787135911.001468:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787135911.380721:0:11448:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 06:38:29 (1787135909) === 00000100:00100000:2.0:1787135911.387342:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616398336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135911.387407:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135911.387485:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616398336 00000100:00100000:2.0:1787135911.387493:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616398336 00000100:00100000:2.0:1787135911.387536:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787135911.387545:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616398336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787135911.387579:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135911.387622:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616398336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135911.387641:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787135911.387680:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98533a9180 x1873947616398336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135911.387715:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616398336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135911.396489:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616398464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135911.396561:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135911.396703:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616398464 00000100:00100000:0.0:1787135911.396710:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616398464 00000100:00100000:0.0:1787135911.396763:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787135911.396772:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616398464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787135911.396807:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135911.409456:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616398464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12675us (12884us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135911.409470:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1787135911.410422:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9881fc3800 x1873947616398464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135911.410448:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616398464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787135911.573531:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135911.573572:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135911.573609:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595390592 00000100:00100000:3.0:1787135911.573619:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595390592 00000100:00100000:3.0:1787135911.573688:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:3.0:1787135911.573699:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595390592:12345-192.168.203.38@tcp:41:mkdir.0 00000004:00000024:3.0:1787135911.573740:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787135911.573822:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595390592:12345-192.168.203.38@tcp:41:mkdir.0 Request processed in 125us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135911.573830:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00080000:2.0:1787135911.579345:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135911.579375:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595390720 00000100:00100000:2.0:1787135911.579384:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595390720 00000100:00100000:2.0:1787135911.579437:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1787135911.579446:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:9677:x1873947595390720:12345-192.168.203.38@tcp:700:mkdir.0 00000100:00100000:2.0:1787135911.579519:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:9677:x1873947595390720:12345-192.168.203.38@tcp:700:mkdir.0 Request processed in 74us (5946us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135911.579526:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1787135911.588615:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135911.588708:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595390976 00000100:00100000:1.0:1787135911.588718:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595390976 00000100:00100000:1.0:1787135911.588866:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:1.0:1787135911.588878:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:9677:x1873947595390976:12345-192.168.203.38@tcp:36:mkdir.0 00010000:00010000:1.0:1787135911.588927:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135911.588996:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2023b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71812e expref: 6 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.589013:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98532d1200) 00010000:00010000:1.0:1787135911.589024:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787135911.589366:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489200/0xf5850c552f2024cf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.589381:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489200/0xf5850c552f2024cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.589396:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489200/0xf5850c552f2024cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.589408:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024d6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.589415:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.589421:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135911.590547:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787135911.590561:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489200/0xf5850c552f2024cf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.590569:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489200/0xf5850c552f2024cf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.590575:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489200/0xf5850c552f2024cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.590581:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841489200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135911.590585:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489200/0xf5850c552f2024cf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.590592:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489200/0xf5850c552f2024cf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.590606:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9853809900) 00010000:00010000:1.0:1787135911.590609:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135911.590619:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489200/0xf5850c552f2024cf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.590626:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489200/0xf5850c552f2024cf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787135911.590658:0:5823:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000000b4f3fa9 reply state 000000005e0fd634 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135911.590666:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787135911.590768:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:9677:x1873947595390976:12345-192.168.203.38@tcp:36:mkdir.0 Request processed in 1891us (2159us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787135911.590775:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00010000:00010000:3.0:1787135911.594982:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024d6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.595010:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024d6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.595018:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024d6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.595025:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841488a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135911.595031:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024d6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.595039:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024d6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.595085:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e9853809e00) 00010000:00010000:3.0:1787135911.595089:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135911.595094:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024d6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.595101:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024d6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135911.599689:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135911.599893:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595391104 00000100:00100000:3.0:1787135911.599902:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595391104 00000100:00100000:3.0:1787135911.599971:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:3.0:1787135911.599985:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:9678:x1873947595391104:12345-192.168.203.38@tcp:101:chmod.0 00010000:00010000:3.0:1787135911.600006:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135911.600029:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2024dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181b3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.600147:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2024e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.600162:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2024e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.600175:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2024e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135911.600233:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787135911.600237:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787135911.600275:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2024e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.600300:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2024dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181b3 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.600315:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2024e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181b3 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.600520:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179f00) 00010000:00010000:3.0:1787135911.600524:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787135911.600528:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db800, rc 0) 00000100:00100000:3.0:1787135911.600592:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:9678:x1873947595391104:12345-192.168.203.38@tcp:101:chmod.0 Request processed in 612us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135911.600598:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1787135911.604021:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135911.604446:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595391360 00000100:00100000:2.0:1787135911.604456:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595391360 00000100:00100000:2.0:1787135911.604507:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:2.0:1787135911.604517:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:9678:x1873947595391360:12345-192.168.203.38@tcp:36:chmod.0 00010000:00010000:2.0:1787135911.604569:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135911.604598:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2024e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181b3 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.604616:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179f00) 00010000:00010000:2.0:1787135911.604627:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135911.604693:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2024eb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.604706:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2024eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.604714:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2024eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787135911.605033:0:5821:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000005f8d37a8 reply state 000000000bde7130 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2024eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135911.605042:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787135911.605074:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787135911.605160:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:9678:x1873947595391360:12345-192.168.203.38@tcp:36:chmod.0 Request processed in 643us (1147us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787135911.605167:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00010000:00010000:0.0:1787135911.607952:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2024eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.607978:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2024eb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.607986:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2024eb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.607992:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135911.607997:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2024eb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.608005:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2024eb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.608024:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98532d1f00) 00010000:00010000:0.0:1787135911.608027:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787135911.608031:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2024eb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.608037:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2024eb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135911.643082:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135911.643203:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595391488 00000100:00100000:1.0:1787135911.643213:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595391488 00000100:00100000:1.0:1787135911.643320:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:1.0:1787135911.643343:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:9679:x1873947595391488:12345-192.168.203.38@tcp:101:chown.0 00010000:00010000:1.0:1787135911.643366:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135911.643387:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489200/0xf5850c552f2024f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181ba expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.643451:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.643466:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.643484:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135911.643538:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787135911.643555:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787135911.643603:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.643641:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489200/0xf5850c552f2024f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181ba expref: 9 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.643662:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181ba expref: 8 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.643671:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9853809900) 00010000:00010000:1.0:1787135911.643674:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787135911.643677:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9841488a00, rc 0) 00000100:00100000:1.0:1787135911.643740:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:9679:x1873947595391488:12345-192.168.203.38@tcp:101:chown.0 Request processed in 399us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135911.643749:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:2.0:1787135911.649567:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135911.649682:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595391616 00000100:00100000:1.0:1787135911.649692:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595391616 00000100:00100000:1.0:1787135911.649782:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:1.0:1787135911.649793:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:9679:x1873947595391616:12345-192.168.203.38@tcp:101:chown.0 00010000:00010000:1.0:1787135911.649814:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135911.649836:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489000/0xf5850c552f202500 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181c1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.649903:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489e00/0xf5850c552f202507 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.649918:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489e00/0xf5850c552f202507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.649945:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489e00/0xf5850c552f202507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650120:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488400/0xf5850c552f20250e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650130:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488400/0xf5850c552f20250e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650137:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488400/0xf5850c552f20250e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650239:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650248:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650254:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135911.650290:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787135911.650293:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787135911.650314:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650395:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489e00/0xf5850c552f202507 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650403:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489e00/0xf5850c552f202507 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650421:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489e00/0xf5850c552f202507 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650427:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841489e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135911.650432:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489e00/0xf5850c552f202507 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650439:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489e00/0xf5850c552f202507 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650451:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9853809900) 00010000:00010000:1.0:1787135911.650454:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135911.650458:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489e00/0xf5850c552f202507 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650464:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489e00/0xf5850c552f202507 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650483:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488400/0xf5850c552f20250e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650489:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488400/0xf5850c552f20250e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650494:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488400/0xf5850c552f20250e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650498:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841488400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135911.650500:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488400/0xf5850c552f20250e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650515:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488400/0xf5850c552f20250e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650523:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e9853809400) 00010000:00010000:1.0:1787135911.650526:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135911.650529:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488400/0xf5850c552f20250e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650534:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488400/0xf5850c552f20250e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650566:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841489000/0xf5850c552f202500 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181c1 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650579:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181c1 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.650585:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9853809b00) 00010000:00010000:1.0:1787135911.650587:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787135911.650589:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533ae000, rc 0) 00000100:00100000:1.0:1787135911.650749:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:9679:x1873947595391616:12345-192.168.203.38@tcp:101:chown.0 Request processed in 956us (1190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135911.650757:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:0.0:1787135911.662146:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135911.662357:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595391872 00000100:00100000:3.0:1787135911.662367:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595391872 00000100:00100000:3.0:1787135911.662448:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:3.0:1787135911.662458:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:9679:x1873947595391872:12345-192.168.203.38@tcp:36:chown.0 00010000:00010000:3.0:1787135911.662521:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135911.662547:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202515 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181c1 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.662564:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9853809b00) 00010000:00010000:3.0:1787135911.662574:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787135911.662598:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f20251c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.662611:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f20251c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.662620:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f20251c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787135911.700283:0:5822:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000006dfb737e reply state 00000000ff73ef94 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f20251c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135911.700301:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787135911.700482:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787135911.700599:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:9679:x1873947595391872:12345-192.168.203.38@tcp:36:chown.0 Request processed in 38138us (38460us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787135911.700608:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000001:00080000:3.0:1787135911.711096:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:3.0:1787135911.711117:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:3.0:1787135911.711134:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1787135911.711531:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f20251c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.711544:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f20251c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.711551:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f20251c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.711558:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511dbe00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135911.711563:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f20251c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.711570:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f20251c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.711586:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e9843179900) 00010000:00010000:1.0:1787135911.711589:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787135911.711593:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f20251c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.711598:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f20251c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135911.717444:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135911.717749:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595392000 00000100:00100000:2.0:1787135911.717759:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595392000 00000100:00100000:2.0:1787135911.717821:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1787135911.717831:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:9680:x1873947595392000:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:2.0:1787135911.717852:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135911.717873:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202523 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181c8 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787135911.721153:0:5823:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3232us 00010000:00010000:0.0:1787135911.754888:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f20252a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.754910:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f20252a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.754921:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f20252a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.754938:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202531 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.754946:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.754952:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759153:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202538 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759175:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759188:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135911.759278:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787135911.759282:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787135911.759520:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202538 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759535:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f20252a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759549:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f20252a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759557:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f20252a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759562:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135911.759567:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f20252a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759574:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f20252a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759586:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9853809900) 00010000:00010000:0.0:1787135911.759589:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135911.759593:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f20252a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759598:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f20252a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759610:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759616:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202531 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759622:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202531 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759637:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135911.759646:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202531 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759653:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202531 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759662:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e98494a1a00) 00010000:00010000:0.0:1787135911.759664:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135911.759667:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202531 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759672:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202531 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759713:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202523 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181c8 expref: 8 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759733:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202538 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181c8 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.759740:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:0.0:1787135911.759742:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787135911.759744:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896a00, rc 0) 00000100:00100000:0.0:1787135911.759864:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:9680:x1873947595392000:12345-192.168.203.38@tcp:101:touch.500 Request processed in 42032us (42426us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135911.759873:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1787135911.768550:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135911.769193:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595392256 00000100:00100000:3.0:1787135911.769204:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595392256 00000100:00100000:3.0:1787135911.769277:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:3.0:1787135911.769289:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:9680:x1873947595392256:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:3.0:1787135911.769312:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135911.769332:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20253f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181cf expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.769737:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202546 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.769757:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202546 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.769768:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202546 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.769796:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f20254d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.769803:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f20254d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.769809:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f20254d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787135911.770558:0:7623:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787135911.770819:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202554 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.770831:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.770840:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.770871:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202546 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.770878:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202546 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.770884:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202546 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.770896:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511dbe00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135911.770901:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202546 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.770908:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202546 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.770920:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:3.0:1787135911.770923:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135911.770927:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202546 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.770933:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202546 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787135911.770946:0:7623:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000ea4b8c1f reply state 0000000037c98d19 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f20254d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135911.770954:0:7623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787135911.770985:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20253f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181cf expref: 10 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.770998:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181cf expref: 9 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.771006:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9843179000) 00010000:00010000:3.0:1787135911.771008:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787135911.771010:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dac00, rc 0) 00000100:00100000:3.0:1787135911.771103:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:9680:x1873947595392256:12345-192.168.203.38@tcp:101:touch.500 Request processed in 1817us (2563us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787135911.771116:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:2.0:1787135911.774238:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135911.774387:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595392512 00000100:00100000:1.0:1787135911.774398:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595392512 00000100:00100000:1.0:1787135911.774455:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:1.0:1787135911.774466:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:9680:x1873947595392512:12345-192.168.203.38@tcp:36:touch.500 00010000:00010000:1.0:1787135911.774529:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135911.774556:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202554 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181cf expref: 10 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.774574:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9843179000) 00010000:00010000:1.0:1787135911.774583:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787135911.774622:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202562 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.774644:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.774653:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.774714:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f20254d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.774724:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f20254d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.774738:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f20254d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.774744:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135911.774749:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f20254d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.774757:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f20254d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.774779:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff8e9843179e00) 00010000:00010000:0.0:1787135911.774783:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000004:00010000:1.0:1787135911.774786:0:5821:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000012e461b6 reply state 00000000051e4c7d transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.774787:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f20254d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135911.774805:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787135911.774805:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f20254d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135911.774893:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:9680:x1873947595392512:12345-192.168.203.38@tcp:36:touch.500 Request processed in 429us (663us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787135911.774900:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00010000:00010000:1.0:1787135911.777644:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.777661:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202562 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.777670:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202562 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.777692:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aea00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135911.777697:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202562 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.777705:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202562 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.777731:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9853809400) 00010000:00010000:1.0:1787135911.777735:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135911.777739:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202562 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.777746:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202562 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135911.778748:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135911.779209:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595392640 00000100:00100000:3.0:1787135911.779219:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595392640 00000100:00100000:3.0:1787135911.779280:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1787135911.779342:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:9680:x1873947595392640:12345-192.168.203.38@tcp:101:touch.500 00010000:00010000:3.0:1787135911.779366:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135911.779385:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f202569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181d6 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.779438:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f202569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181d6 expref: 10 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.779514:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f202569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181d6 expref: 10 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.779531:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9843179400) 00010000:00010000:3.0:1787135911.779534:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135911.779536:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da000, rc 0) 00000100:00100000:3.0:1787135911.779638:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:9680:x1873947595392640:12345-192.168.203.38@tcp:101:touch.500 Request processed in 342us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135911.779646:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:2.0:1787135911.784447:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135911.784667:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595392768 00000100:00100000:1.0:1787135911.784678:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595392768 00000100:00100000:1.0:1787135911.784734:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:1.0:1787135911.784743:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873947595392768:12345-192.168.203.38@tcp:8:touch.500 00010000:00080000:1.0:1787135911.784776:0:6672:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:1.0:1787135911.784972:0:6672:0:(genops.c:1406:class_connect()) connect: client a1006dc5-9c90-4762-af1c-1ab0be9a05b8, cookie 0xf5850c552f202570 00002000:00100000:1.0:1787135911.784986:0:6672:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a1006dc5-9c90-4762-af1c-1ab0be9a05b8/ffff8e987486c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113908 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787135911.784997:0:6672:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787135911.785280:0:6672:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787135911.785310:0:6672:0:(import.c:65:import_set_state_nolock()) ffff8e987486a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787135911.785377:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2358:x1873947595392768:12345-192.168.203.38@tcp:8:touch.500 Request processed in 634us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135911.785402:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1787135911.789132:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135911.789235:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595392896 00000100:00100000:3.0:1787135911.789246:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595392896 00000100:00100000:3.0:1787135911.789338:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:3.0:1787135911.789349:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:0:x1873947595392896:12345-192.168.203.38@tcp:2:touch.500 00000100:00080000:2.0:1787135911.790822:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787135911.871915:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:0:x1873947595392896:12345-192.168.203.38@tcp:2:touch.500 Request processed in 82559us (82784us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787135911.871941:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000001:00100000:1.0:1787135911.872305:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000001:00080000:1.0:1787135911.872424:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1787135911.877015:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135911.877236:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595393152 00000100:00100000:0.0:1787135911.877246:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595393152 00000100:00100000:0.0:1787135911.877326:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1787135911.877337:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:9680:x1873947595393152:12345-192.168.203.38@tcp:35:touch.500 00000100:00100000:0.0:1787135911.877678:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+11:9680:x1873947595393152:12345-192.168.203.38@tcp:35:touch.500 Request processed in 342us (671us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787135911.877685:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1787135911.889723:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135911.889874:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595393280 00000100:00100000:1.0:1787135911.889884:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595393280 00000100:00100000:1.0:1787135911.889939:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:1.0:1787135911.889950:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+11:9681:x1873947595393280:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:1.0:1787135911.889973:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135911.889992:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202577 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181dd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.890090:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af000/0xf5850c552f20257e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.890104:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af000/0xf5850c552f20257e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.890115:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af000/0xf5850c552f20257e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135911.890169:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787135911.890173:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787135911.890236:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af000/0xf5850c552f20257e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.890262:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202577 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181dd expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.890278:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af000/0xf5850c552f20257e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181dd expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.890292:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:1.0:1787135911.890296:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787135911.890299:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533af000, rc 0) 00000100:00100000:0.0:1787135911.890560:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+12:9681:x1873947595393280:12345-192.168.203.38@tcp:101:rm.0 Request processed in 611us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135911.890577:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:3.0:1787135911.907762:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135911.907899:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595393536 00000100:00100000:1.0:1787135911.907909:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595393536 00000100:00100000:1.0:1787135911.907965:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:1.0:1787135911.907981:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+12:9681:x1873947595393536:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:1.0:1787135911.908001:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135911.908018:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202585 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181e4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135911.908156:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787135911.908291:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202585 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181e4 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.908306:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9853809900) 00010000:00010000:1.0:1787135911.908308:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787135911.908313:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202585 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181e4 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.908336:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533aea00, rc 0) 00000100:00100000:1.0:1787135911.908380:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:9681:x1873947595393536:12345-192.168.203.38@tcp:101:rm.0 Request processed in 407us (627us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1787135911.908387:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:2.0:1787135911.919526:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135911.919606:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595393664 00000100:00100000:0.0:1787135911.919615:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595393664 00000100:00100000:0.0:1787135911.919690:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1787135911.919700:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:9681:x1873947595393664:12345-192.168.203.38@tcp:37:rm.0 00000100:00100000:0.0:1787135911.923842:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:9681:x1873947595393664:12345-192.168.203.38@tcp:37:rm.0 Request processed in 4132us (4315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135911.923855:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:3.0:1787135911.931444:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135911.931539:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595393920 00000100:00100000:1.0:1787135911.931549:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595393920 00000100:00100000:1.0:1787135911.931621:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:1.0:1787135911.931640:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9860736850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:9681:x1873947595393920:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:1.0:1787135911.931891:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9860736850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:9681:x1873947595393920:12345-192.168.203.38@tcp:35:rm.0 Request processed in 261us (456us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787135911.931900:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:2.0:1787135911.934136:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135911.934950:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595394176 00000100:00100000:0.0:1787135911.934961:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595394176 00000100:00100000:0.0:1787135911.935021:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:0.0:1787135911.935030:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:9681:x1873947595394176:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:0.0:1787135911.935084:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135911.935103:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202593 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181eb expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.935216:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20259a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.935231:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20259a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.935241:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20259a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135911.935253:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787135911.935380:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202593 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181eb expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.935415:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20259a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181eb expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.935424:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:0.0:1787135911.935427:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787135911.935430:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896e00, rc 0) 00000100:00100000:0.0:1787135911.935532:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:9681:x1873947595394176:12345-192.168.203.38@tcp:101:rm.0 Request processed in 502us (1404us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787135911.935541:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:2.0:1787135911.940368:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135911.940444:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595394304 00000100:00100000:1.0:1787135911.940455:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595394304 00000100:00100000:1.0:1787135911.940511:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:1.0:1787135911.940520:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:9681:x1873947595394304:12345-192.168.203.38@tcp:41:rm.0 00000004:00000024:1.0:1787135911.940571:0:5822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1787135911.940642:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:9681:x1873947595394304:12345-192.168.203.38@tcp:41:rm.0 Request processed in 123us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135911.940651:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:0.0:1787135911.945179:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135911.945287:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595394432 00000100:00100000:2.0:1787135911.945297:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595394432 00000100:00100000:2.0:1787135911.945354:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:2.0:1787135911.945364:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:9681:x1873947595394432:12345-192.168.203.38@tcp:101:rm.0 00010000:00010000:2.0:1787135911.945385:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135911.945404:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2025a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181f2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945464:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2025af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945478:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2025af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945488:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2025af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945501:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f2025b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945508:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f2025b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945531:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f2025b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945649:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2025bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945657:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2025bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945664:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2025bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135911.945690:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787135911.945695:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135911.945726:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2025bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945738:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2025bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945746:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2025af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945753:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2025af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945759:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2025af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945765:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135911.945769:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2025af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945783:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2025af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945806:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:2.0:1787135911.945809:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135911.945813:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2025af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945819:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2025af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945837:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f2025b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945843:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f2025b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945849:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f2025b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945855:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135911.945857:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f2025b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945863:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f2025b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945871:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff8e98532d1c00) 00010000:00010000:2.0:1787135911.945874:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135911.945877:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f2025b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945892:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f2025b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945922:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2025a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181f2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945937:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2025bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181f2 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135911.945945:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9843179400) 00010000:00010000:2.0:1787135911.945947:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787135911.945950:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6c00, rc 0) 00000100:00100000:2.0:1787135911.946374:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+17:9681:x1873947595394432:12345-192.168.203.38@tcp:101:rm.0 Request processed in 1010us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135911.946384:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:2.0:1787135911.957290:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135911.961266:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595394688 00000100:00100000:1.0:1787135911.961292:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595394688 00000100:00100000:1.0:1787135911.961376:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:1.0:1787135911.961396:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+17:9681:x1873947595394688:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:1.0:1787135911.961447:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787135911.961475:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2025bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181f2 expref: 17 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.961504:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f202569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181d6 expref: 16 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.961516:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9843179400) 00010000:00010000:1.0:1787135911.961531:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af000/0xf5850c552f20257e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181dd expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.961552:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:1.0:1787135911.961556:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787135911.961574:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f2025c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.961585:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f2025c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.961594:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f2025c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.961608:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2025cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.961615:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2025cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.961622:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2025cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.962029:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f2025d2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.962039:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f2025d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.962092:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f2025d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787135911.963611:0:5822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787135911.963634:0:5822:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 271906576908ns, next at 272906574304ns, rc = 0 00010000:00010000:1.0:1787135911.963707:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2025d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963792:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2025d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963802:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2025d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963810:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2025d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963816:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2025d9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963821:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2025d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963885:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787135911.963906:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f2025d2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963913:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f2025d2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963920:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f2025d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963926:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aee00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135911.963931:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f2025d2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963938:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f2025d2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963958:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9853809400) 00010000:00010000:1.0:1787135911.963960:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787135911.963965:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f2025d2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963970:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f2025d2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.963998:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f2025c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.964004:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f2025c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.964009:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f2025c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.964014:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aea00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135911.964017:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f2025c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.964023:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f2025c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.964031:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:1.0:1787135911.964033:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135911.964035:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f2025c4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.964041:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f2025c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787135911.964084:0:5822:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000003b4dd8ab reply state 000000009de5f7da transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2025cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135911.964092:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787135911.964181:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:9681:x1873947595394688:12345-192.168.203.38@tcp:36:rm.0 Request processed in 2784us (6908us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1787135911.964189:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:2.0:1787135911.970682:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1787135911.971110:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2025cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.971123:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2025cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.971131:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2025cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.971137:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135911.971142:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2025cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.971149:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2025cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.971164:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc51bb70 (ffff8e9853809600) 00010000:00010000:3.0:1787135911.971167:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135911.971171:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2025cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135911.971177:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2025cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc51bb70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135911.972077:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595394944 00000100:00100000:1.0:1787135911.972087:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595394944 00000100:00100000:1.0:1787135911.972135:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1787135911.972144:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:9681:x1873947595394944:12345-192.168.203.38@tcp:35:rm.0 00000100:00100000:1.0:1787135911.972387:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:9681:x1873947595394944:12345-192.168.203.38@tcp:35:rm.0 Request processed in 243us (1713us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787135911.972394:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00010000:00010000:0.0:1787135911.973623:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787135911.973642:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2025d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.973653:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afc00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787135911.973657:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2025d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.973665:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2025d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.973681:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e9853809400) 00010000:00010000:0.0:1787135911.973684:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787135911.973688:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2025d9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.973694:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2025d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.973738:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135911.973739:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135911.973741:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135911.978477:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135911.978552:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595395200 00000100:00100000:0.0:1787135911.978561:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595395200 00000100:00100000:0.0:1787135911.978616:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:0.0:1787135911.978634:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:9681:x1873947595395200:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1787135911.978682:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787135911.978707:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20259a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181eb expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.978734:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202538 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181c8 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.978743:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:0.0:1787135911.978756:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9841488a00/0xf5850c552f2024f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181ba expref: 14 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.978764:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9853809900) 00010000:00010000:0.0:1787135911.978771:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787135911.978792:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2025e0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.978804:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2025e0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.978812:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2025e0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.978842:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2025e7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.978849:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2025e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.978855:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2025e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.983362:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2025ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.983539:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2025ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.983552:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2025ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135911.985547:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787135911.985571:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2025ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985581:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2025ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985588:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2025ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985594:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135911.985598:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2025ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985623:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2025ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985649:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:0.0:1787135911.985652:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787135911.985657:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2025ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985663:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2025ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985690:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2025e0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985696:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2025e0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985702:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2025e0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985707:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135911.985720:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2025e0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985726:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2025e0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985734:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:0.0:1787135911.985737:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135911.985740:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2025e0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135911.985756:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2025e0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787135911.985768:0:5823:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000eaa36ac4 reply state 000000005dd5ff06 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2025e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135911.985777:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787135911.986040:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:9681:x1873947595395200:12345-192.168.203.38@tcp:36:rm.0 Request processed in 7349us (7505us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1787135911.986073:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00010000:00010000:1.0:1787135911.990888:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2025e7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.990910:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2025e7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.990917:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2025e7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.990924:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135911.990929:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2025e7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.990938:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2025e7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.990969:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e98494a1f00) 00010000:00010000:1.0:1787135911.990981:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135911.990986:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2025e7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135911.990992:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2025e7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135912.026853:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135913.054665:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135914.073919:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135914.858757:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135914.858837:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595395328 00000100:00100000:0.0:1787135914.858849:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595395328 00000100:00100000:0.0:1787135914.858908:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 244 00000100:00100000:0.0:1787135914.858918:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595395328:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135914.858987:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595395328:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135914.858995:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 244 00000100:00100000:2.0:1787135914.867550:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135914.867587:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135914.867631:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135914.867719:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595395456 00000100:00100000:3.0:1787135914.867730:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595395456 00000100:00100000:3.0:1787135914.867789:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595395712 00000100:00100000:3.0:1787135914.867805:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595395712 00000100:00100000:3.0:1787135914.867831:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:3.0:1787135914.867841:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:2359:x1873947595395456:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135914.867918:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:2359:x1873947595395456:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 78us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135914.867926:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:3.0:1787135914.867944:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:3.0:1787135914.867951:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595395712:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135914.867988:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595395712:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 38us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135914.867994:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00080000:2.0:1787135914.868248:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135914.868851:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595395584 00000100:00100000:0.0:1787135914.868859:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595395584 00000100:00100000:0.0:1787135914.868924:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:0.0:1787135914.868933:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595395584:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135914.868989:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595395584:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 57us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135914.868996:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00080000:2.0:1787135914.869671:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787135915.096402:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135915.996626:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616398848:0@lo:400:kworker.0 00000100:00100000:3.0:1787135915.996687:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135915.996739:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787135915.996746:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616398976:0@lo:400:kworker.0 00000100:00100000:3.0:1787135915.996769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135915.996805:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616398848 00000100:00100000:3.0:1787135915.996811:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616398848 00000100:00100000:3.0:1787135915.996862:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787135915.996870:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616398848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135915.996918:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616398848:12345-0@lo:400:kworker.0 Request processed in 47us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135915.996925:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787135915.996944:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616398976 00000100:00100000:3.0:1787135915.996948:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616398976 00000100:00100000:3.0:1787135915.996974:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787135915.996986:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616398976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135915.997016:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616398976:12345-0@lo:400:kworker.0 Request processed in 31us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135915.997022:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787135915.997037:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787135915.997042:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787135915.997088:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d8e00 x1873947616398976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135915.997101:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616398976:0@lo:400:kworker.0 00000100:00100000:3.0:1787135915.997112:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616398848:0@lo:400:kworker.0 00000100:00100000:0.0:1787135915.997191:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616398592:0@lo:400:kworker.0 00000100:00100000:0.0:1787135915.997225:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135915.997254:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616399104:0@lo:400:kworker.0 00000100:00100000:0.0:1787135915.997277:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135915.997295:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787135915.997300:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616398720:0@lo:400:kworker.0 00000100:00100000:0.0:1787135915.997320:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135915.997338:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616399232:0@lo:400:kworker.0 00000100:00100000:0.0:1787135915.997358:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135915.997382:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616399104 00000100:00100000:0.0:1787135915.997386:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616399104 00000100:00100000:0.0:1787135915.997413:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616398720 00000100:00100000:0.0:1787135915.997416:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616398720 00000100:00100000:0.0:1787135915.997433:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787135915.997439:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616399104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135915.997472:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616399104:12345-0@lo:400:kworker.0 Request processed in 34us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135915.997478:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787135915.997492:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787135915.997497:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616398720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135915.997521:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616398720:12345-0@lo:400:kworker.0 Request processed in 24us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135915.997526:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787135915.997544:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616399232 00000100:00100000:0.0:1787135915.997547:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616399232 00000100:00100000:0.0:1787135915.997568:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787135915.997574:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616399232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135915.997620:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616399232:12345-0@lo:400:kworker.0 Request processed in 46us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135915.997627:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1787135915.997641:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787135915.997643:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135915.997664:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616398720:0@lo:400:kworker.0 00010000:00080000:0.0:1787135915.997674:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876cac700 x1873947616399232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135915.997682:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616399232:0@lo:400:kworker.0 00000100:00100000:0.0:1787135915.997691:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616399104:0@lo:400:kworker.0 00000100:00100000:3.0:1787135915.997818:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616398592 00000100:00100000:3.0:1787135915.997823:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616398592 00000100:00100000:3.0:1787135915.997855:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787135915.997862:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616398592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135915.997896:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616398592:12345-0@lo:400:kworker.0 Request processed in 35us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135915.997903:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787135915.997932:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616398592:0@lo:400:kworker.0 00010000:00010000:3.0:1787135916.125724:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787135916.150624:0:11597:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000004:00080000:2.0:1787135916.504270:0:8042:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 276447218749ns, next at 277447216501ns, rc = 0 00000100:00100000:1.0:1787135916.504415:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616399488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787135916.504486:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135916.504490:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616399360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135916.504568:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616399488 00000100:00100000:2.0:1787135916.504576:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616399488 00000100:00100000:2.0:1787135916.504642:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787135916.504651:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616399488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787135916.504685:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135916.513732:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135916.515198:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616399488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10539us (10702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135916.515214:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787135916.515248:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616399360 00000100:00100000:2.0:1787135916.515256:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616399360 00000100:00100000:1.0:1787135916.515733:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787135916.515747:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616399360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787135916.515784:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135916.515833:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874495c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616399360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135916.515840:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787135916.516129:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987c4c3800 x1873947616399360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135916.516149:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616399360:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787135916.519112:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876caf800 x1873947616399488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135916.519142:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616399488:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787135917.069099:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1787135917.069127:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:0.0:1787135917.069141:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:2.0:1787135917.069303:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787135917.069332:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616399616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787135917.069398:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135917.069429:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616399616 00000100:00100000:3.0:1787135917.069436:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616399616 00000100:00100000:3.0:1787135917.069535:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787135917.069552:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616399616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787135917.069577:0:6672:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1787135917.069619:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8587a7, atime: 0x6a8587a7, ctime: 0x6a8587a7, blocks: 0x1 00010000:00010000:3.0:1787135917.069627:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000419eefa0/0xf5850c552f2025f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.069642:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=277s v=(0 0) 00010000:00010000:3.0:1787135917.069646:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787135917.069652:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000419eefa0/0xf5850c552f2025f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.069669:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000419eefa0/0xf5850c552f2025f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.069679:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000419eefa0/0xf5850c552f2025f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.069687:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000419eefa0/0xf5850c552f2025f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.069709:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787135917.069741:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787135917.069748:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000419eefa0/0xf5850c552f2025f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135917.069756:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787135917.069760:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000419eefa0/0xf5850c552f2025f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135917.069768:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000419eefa0/0xf5850c552f2025f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135917.069797:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000419eefa0/0xf5850c552f2025f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135917.069805:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000419eefa0/0xf5850c552f2025f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135917.069822:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135917.069823:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135917.069824:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135917.070215:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1873947616399616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 664us (815us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787135917.070223:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1787135917.070321:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e987c4c3100/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787135917.070328:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616399616:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1787135917.070570:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787135917.151172:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787135917.431485:0:11647:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3d9d87e0 20000000:00000080:3.0:1787135917.431502:0:11647:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e9881f64400 uarg=0000000000000000 20000000:01000000:3.0:1787135917.431544:0:11647:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787135917.431552:0:11647:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1787135917.431557:0:11647:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787135917.433553:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787135917.433740:0:11647:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787135917.439989:0:11647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787135917.440411:0:11647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787135917.440481:0:11647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787135917.440501:0:11647:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787135917.440522:0:11647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.440543:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9841489c00/0xf5850c552f202497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181a5 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.440552:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98511da200/0xf5850c552f20249e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181ac expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.440560:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9874896400/0xf5850c552f2024ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2024a5 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.440567:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98511da400/0xf5850c552f2024ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2024b3 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.440573:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98511db400/0xf5850c552f2024c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2024c1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.440581:0:11647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.440633:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98511db400/0xf5850c552f2024c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f2024c1 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.440665:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e98511db400/0xf5850c552f2024c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f2024c1 expref: 18 pid: 5815 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135917.440680:0:11647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1873947616399744:0@lo:104: 00000100:00100000:3.0:1787135917.440740:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787135917.440811:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98511da400/0xf5850c552f2024ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f2024b3 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.440820:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e98511da400/0xf5850c552f2024ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f2024b3 expref: 18 pid: 5813 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135917.440828:0:11647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1873947616399872:0@lo:104: 00000100:00100000:3.0:1787135917.440849:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787135917.440877:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9874896400/0xf5850c552f2024ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f2024a5 expref: 18 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.440886:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e9874896400/0xf5850c552f2024ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f2024a5 expref: 18 pid: 5815 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135917.440893:0:11647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1873947616400000:0@lo:104: 00000100:00100000:3.0:1787135917.440917:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787135917.440936:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98511da200/0xf5850c552f20249e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181ac expref: 12 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.440946:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e98511da200/0xf5850c552f20249e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181ac expref: 12 pid: 5813 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135917.440956:0:11647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1873947616400128:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135917.441491:0:5805:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787135917.441507:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616399744 00000100:00100000:2.0:1787135917.441513:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616399744 00000100:00100000:2.0:1787135917.441547:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616399872 00000100:00100000:2.0:1787135917.441550:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616399872 00000100:00100000:2.0:1787135917.441559:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616400000 00000100:00100000:2.0:1787135917.441561:0:5805:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616400000 00000100:00100000:2.0:1787135917.441572:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787135917.441579:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+5:11647:x1873947616399744:12345-0@lo:104: 00010000:00010000:2.0:1787135917.441603:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2024c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.441653:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787135917.441659:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+5:11647:x1873947616399744:12345-0@lo:104: Request processed in 80us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135917.441676:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787135917.441693:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787135917.441698:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+4:11647:x1873947616399872:12345-0@lo:104: 00010000:00010000:2.0:1787135917.441706:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2024ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.441741:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787135917.441746:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+4:11647:x1873947616399872:12345-0@lo:104: Request processed in 48us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135917.441751:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787135917.441762:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787135917.441767:0:5805:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9745123850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:11647:x1873947616400000:12345-0@lo:104: 00010000:00010000:2.0:1787135917.441775:0:5805:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2024ac expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.441813:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787135917.441818:0:5805:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9745123850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e67bffa2-3749-4eab-9303-62ad12948de4+3:11647:x1873947616400000:12345-0@lo:104: Request processed in 52us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135917.441824:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1787135917.441860:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787135917.441867:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2024c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.441874:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897400 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135917.441878:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f2024c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.441896:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f2024c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135917.441903:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f2024c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135917.441909:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787135917.441937:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2024c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.441944:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135917.441962:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2024c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.441968:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9874897400/0xf5850c552f2024c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2024c8 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.441980:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787135917.441983:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2024ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.441988:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897600 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135917.441991:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f2024ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.441996:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f2024ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135917.442001:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f2024ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135917.442012:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787135917.442026:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2024ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.442031:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135917.442065:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2024ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.442071:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9874897600/0xf5850c552f2024b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2024ba expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.442079:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787135917.442082:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2024ac expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.442087:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841489600 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787135917.442089:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f2024ac expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.442095:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f2024ac expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787135917.442100:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f2024ac expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135917.442105:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787135917.442116:0:5809:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2024ac expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.442122:0:5809:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787135917.442134:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2024ac expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.442140:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9841489600/0xf5850c552f2024a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2024ac expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135917.442475:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616400512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787135917.442513:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135917.442537:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787135917.442543:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616400384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787135917.442563:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135917.442603:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616400512 00000100:00100000:3.0:1787135917.442608:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616400512 00010000:00010000:3.0:1787135917.442628:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9874896400/0xf5850c552f2024ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2024a5 expref: 19 pid: 5815 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135917.442648:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616400384 00000100:00100000:3.0:1787135917.442651:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616400384 00010000:00010000:3.0:1787135917.442662:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98511da400/0xf5850c552f2024ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2024b3 expref: 20 pid: 5813 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135917.442677:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787135917.442684:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e67bffa2-3749-4eab-9303-62ad12948de4+20:3301:x1873947616400512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787135917.442696:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135917.442701:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9874896400/0xf5850c552f2024ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2024a5 expref: 20 pid: 5815 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.442710:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9874896400/0xf5850c552f2024ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f2024a5 expref: 20 pid: 5815 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.442725:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135917.442754:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e67bffa2-3749-4eab-9303-62ad12948de4+20:3301:x1873947616400512:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135917.442760:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787135917.442772:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787135917.442798:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616400384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787135917.442805:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135917.442809:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98511da400/0xf5850c552f2024ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2024b3 expref: 19 pid: 5813 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.442816:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98511da400/0xf5850c552f2024ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f2024b3 expref: 19 pid: 5813 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.442825:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135917.442847:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616400384:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135917.442852:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787135917.442891:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616400384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787135917.442899:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616400512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787135917.442930:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9841489c00/0xf5850c552f202497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181a5 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135917.442941:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e9841489c00/0xf5850c552f202497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181a5 expref: 12 pid: 5815 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135917.442952:0:11647:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1873947616400640:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135917.442997:0:11647:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c4e0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787135917.443009:0:11647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caf800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1873947616399744:0@lo:104: 00010000:00010000:3.0:1787135917.443018:0:11647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511da400/0xf5850c552f2024ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f2024b3 expref: 18 pid: 5813 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135917.443027:0:11647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1873947616399872:0@lo:104: 00010000:00010000:3.0:1787135917.443044:0:11647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9874896400/0xf5850c552f2024ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f2024a5 expref: 17 pid: 5815 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.443176:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135917.443178:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135917.443180:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135917.443847:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616400256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787135917.443889:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787135917.444235:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135917.444252:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616400256 00000100:00100000:0.0:1787135917.444259:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616400256 00010000:00010000:0.0:1787135917.444302:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98511db400/0xf5850c552f2024c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2024c1 expref: 18 pid: 5815 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135917.444331:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787135917.444339:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+18:3303:x1873947616400256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787135917.444350:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135917.444355:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98511db400/0xf5850c552f2024c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2024c1 expref: 18 pid: 5815 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135917.444366:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98511db400/0xf5850c552f2024c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f2024c1 expref: 18 pid: 5815 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135917.444382:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511db400/0xf5850c552f2024c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f2024c1 expref: 18 pid: 5815 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135917.444408:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135917.444448:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+17:3303:x1873947616400256:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135917.444455:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787135917.444513:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616400256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787135917.445357:0:11647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1873947616400000:0@lo:104: 00000100:00100000:3.0:1787135917.445625:0:11647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1873947616400128:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135917.446036:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135917.446465:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135917.446567:0:11647:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1873947616400640:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135917.446612:0:11647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135917.446682:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595395840 00000100:00100000:1.0:1787135917.446699:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595395840 00010000:00010000:1.0:1787135917.446729:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98511da200/0xf5850c552f20249e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181ac expref: 13 pid: 5813 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135917.446761:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595395968 00000100:00100000:1.0:1787135917.446765:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595395968 00010000:00010000:1.0:1787135917.446777:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9841489c00/0xf5850c552f202497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181a5 expref: 14 pid: 5815 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135917.446812:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:1.0:1787135917.446821:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccb52158-7d35-4065-a26d-1bb142899404+14:2359:x1873947595395840:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787135917.446833:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135917.446839:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98511da200/0xf5850c552f20249e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181ac expref: 14 pid: 5813 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135917.446851:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98511da200/0xf5850c552f20249e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181ac expref: 14 pid: 5813 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135917.446869:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511da200/0xf5850c552f20249e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181ac expref: 14 pid: 5813 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135917.446882:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135917.446928:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595395840:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 108us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135917.446935:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:2.0:1787135917.447489:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:2.0:1787135917.447501:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccb52158-7d35-4065-a26d-1bb142899404+12:2359:x1873947595395968:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135917.447511:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135917.447517:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9841489c00/0xf5850c552f202497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181a5 expref: 12 pid: 5815 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.447527:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9841489c00/0xf5850c552f202497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181a5 expref: 12 pid: 5815 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.447538:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841489c00/0xf5850c552f202497 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181a5 expref: 12 pid: 5815 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.447550:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.447559:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.447586:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.447603:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.447610:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.447617:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.447623:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511dbe00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787135917.447628:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.447636:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.447649:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.447657:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135917.449381:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ccb52158-7d35-4065-a26d-1bb142899404+11:2359:x1873947595395968:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 1874us (2907us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135917.449394:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00010000:00010000:2.0:1787135917.449441:0:11647:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.449451:0:11647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135917.449468:0:11647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2025fc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135918.168562:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787135918.680125:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787135918.680132:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e9744a91800 from 7 10000000:01000000:2.0:1787135918.680148:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787135918.680195:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135918.680808:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135918.680821:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135918.680848:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616400768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787135918.680916:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135918.681073:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98744863c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135918.681997:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616400768 00000100:00100000:3.0:1787135918.682007:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616400768 00000100:00100000:3.0:1787135918.682132:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1787135918.682155:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+16:5818:x1873947616400768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787135918.682176:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135918.682195:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511da400/0xf5850c552f20260a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202603 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135918.682218:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511da400/0xf5850c552f20260a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202603 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135918.682889:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511da400/0xf5850c552f20260a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202603 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135918.682899:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da400, rc 0) 00000100:00100000:3.0:1787135918.682968:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616400768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 815us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135918.682975:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787135918.684108:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616400768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787135918.684130:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135918.684142:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135918.684222:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616400896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135918.684270:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135918.684322:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98744863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135918.684387:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616400896 00000100:00100000:1.0:1787135918.684394:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616400896 00000100:00100000:1.0:1787135918.684435:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1787135918.684442:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616400896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135918.684708:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616400896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 266us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135918.684716:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787135918.684903:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616400896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135918.684931:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616401024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787135918.684969:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135918.684995:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98744863c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135918.685462:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616401024 00000100:00100000:0.0:1787135918.685468:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616401024 00000100:00100000:0.0:1787135918.685510:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787135918.685517:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616401024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787135918.685693:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616401024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135918.685701:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787135918.685850:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616401024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787135918.687864:0:11661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:11661:1873947616401152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787135918.687938:0:11661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135918.687983:0:11661:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98517c03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135918.688404:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616401152 00000100:00100000:0.0:1787135918.688411:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616401152 00000100:00100000:0.0:1787135918.688517:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1787135918.688527:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:11661:x1873947616401152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135918.688911:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+17:11661:x1873947616401152:12345-0@lo:502:llog_process_th.0 Request processed in 385us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135918.688918:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1787135918.691690:0:11661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:11661:1873947616401152:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787135918.691740:0:11661:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787135918.691824:0:11661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787135918.691826:0:11661:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787135918.691835:0:11661:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e9744a91800 00000020:00000080:2.0:1787135918.691837:0:11661:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787135918.691934:0:11661:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:11661:1873947616401280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787135918.692005:0:11661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135918.692500:0:11661:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98744863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135918.692549:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616401280 00000100:00100000:1.0:1787135918.692557:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616401280 00000100:00100000:1.0:1787135918.692606:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1787135918.692614:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+17:11661:x1873947616401280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787135918.693767:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+17:11661:x1873947616401280:12345-0@lo:502:llog_process_th.0 Request processed in 1149us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135918.693778:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787135918.693952:0:11661:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:11661:1873947616401280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787135918.693981:0:11661:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787135918.693988:0:11661:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787135918.693991:0:11661:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787135918.693995:0:11661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787135918.694550:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787135918.694569:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787135918.694589:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135918.694603:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135918.694877:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787135918.694880:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e98735aa000 from 7 10000000:01000000:0.0:1787135918.694883:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787135918.694916:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135918.694925:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135918.694934:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135918.694955:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874494700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616401408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787135918.695001:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135918.695442:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607adcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135918.695730:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616401408 00000100:00100000:1.0:1787135918.695738:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616401408 00000100:00100000:1.0:1787135918.695886:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1787135918.695895:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+17:5818:x1873947616401408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787135918.695908:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135918.695921:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98533ae400/0xf5850c552f202618 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f202611 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135918.695945:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98533ae400/0xf5850c552f202618 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f202611 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135918.695956:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98533ae400/0xf5850c552f202618 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f202611 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135918.695980:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533ae400, rc 0) 00000100:00100000:1.0:1787135918.696039:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616401408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135918.696069:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1787135918.696157:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874494700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616401408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787135918.696173:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135918.696183:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135918.696268:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616401536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135918.696297:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135918.697065:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98744863c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135918.697370:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616401536 00000100:00100000:0.0:1787135918.697378:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616401536 00000100:00100000:0.0:1787135918.697415:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787135918.697423:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616401536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787135918.697871:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616401536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 447us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135918.697879:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787135918.697996:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616401536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135918.698071:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616401664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787135918.698116:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135918.698437:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98744863c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135918.698486:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616401664 00000100:00100000:0.0:1787135918.698492:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616401664 00000100:00100000:0.0:1787135918.698525:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1787135918.698532:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616401664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787135918.698680:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616401664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135918.698691:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1787135918.698871:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616401664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787135918.704903:0:11662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:11662:1873947616401792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787135918.704990:0:11662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135918.705034:0:11662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787135918.705977:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616401792 00000100:00100000:1.0:1787135918.705987:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616401792 00000100:00100000:1.0:1787135918.706873:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1787135918.708314:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:11662:x1873947616401792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787135918.711630:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+18:11662:x1873947616401792:12345-0@lo:502:llog_process_th.0 Request processed in 4740us (6633us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135918.711644:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1787135918.715510:0:11662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:11662:1873947616401792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787135918.715554:0:11662:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787135918.715564:0:11662:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135918.715566:0:11662:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787135918.715577:0:11662:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e98735aa000 00000020:00000080:0.0:1787135918.715590:0:11662:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787135918.715689:0:11662:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874494700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:11662:1873947616401920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135918.715758:0:11662:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135918.715791:0:11662:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad600 going to sleep for 11 seconds 00000100:00100000:1.0:1787135918.716133:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616401920 00000100:00100000:1.0:1787135918.716141:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616401920 00000100:00100000:1.0:1787135918.716192:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1787135918.716201:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e985004c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:11662:x1873947616401920:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787135918.718715:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e985004c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+18:11662:x1873947616401920:12345-0@lo:502:llog_process_th.0 Request processed in 2507us (2950us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135918.718729:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787135918.719422:0:11662:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874494700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:11662:1873947616401920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787135918.719454:0:11662:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787135918.719462:0:11662:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135918.719465:0:11662:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787135918.719473:0:11662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787135918.719635:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787135918.719653:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787135918.719664:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135918.719676:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135918.719686:0:5818:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787135918.719689:0:5818:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e98456a5800 from 7 10000000:01000000:2.0:1787135918.719692:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787135918.719722:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135918.719731:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135918.719750:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135918.719769:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616402048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787135918.719808:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135918.719846:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787135918.719890:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616402048 00000100:00100000:0.0:1787135918.719897:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616402048 00000100:00100000:0.0:1787135918.719931:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787135918.719940:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+18:5818:x1873947616402048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787135918.719952:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135918.719964:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9874896c00/0xf5850c552f202626 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20261f expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135918.719984:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9874896c00/0xf5850c552f202626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20261f expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135918.719995:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9874896c00/0xf5850c552f202626 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20261f expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135918.720010:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896c00, rc 0) 00000100:00100000:0.0:1787135918.720076:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616402048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135918.720082:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787135918.722521:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616402048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787135918.722545:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135918.722559:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135918.722657:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616402176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135918.722707:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135918.722741:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2540 going to sleep for 11 seconds 00000100:00100000:1.0:1787135918.722759:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616402176 00000100:00100000:1.0:1787135918.722764:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616402176 00000100:00100000:1.0:1787135918.722801:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787135918.722810:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616402176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135918.723039:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616402176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135918.723072:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787135918.723108:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616402176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787135918.723137:0:5818:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616402304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787135918.723173:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135918.723187:0:5818:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2540 going to sleep for 11 seconds 00000100:00100000:1.0:1787135918.723199:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616402304 00000100:00100000:1.0:1787135918.723202:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616402304 00000100:00100000:1.0:1787135918.723224:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787135918.723229:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616402304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787135918.729512:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:5818:x1873947616402304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6274us (6330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135918.729526:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787135918.730373:0:5818:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e67bffa2-3749-4eab-9303-62ad12948de4:5818:1873947616402304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787135918.733199:0:11665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874494700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:11665:1873947616402432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135918.733381:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135918.733419:0:11665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad180 going to sleep for 11 seconds 00000100:00100000:1.0:1787135918.733519:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616402432 00000100:00100000:1.0:1787135918.733527:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616402432 00000100:00100000:1.0:1787135918.733576:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787135918.733603:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:11665:x1873947616402432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787135918.736444:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:11665:x1873947616402432:12345-0@lo:502:llog_process_th.0 Request processed in 2836us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135918.736458:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1787135918.738722:0:11665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874494700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:11665:1873947616402432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787135918.738766:0:11665:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787135918.738776:0:11665:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135918.738778:0:11665:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787135918.738787:0:11665:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e98456a5800 00000020:00000080:0.0:1787135918.738790:0:11665:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787135918.738888:0:11665:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874494700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:11665:1873947616402560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787135918.738951:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135918.738985:0:11665:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad180 going to sleep for 11 seconds 00000100:00100000:1.0:1787135918.741504:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616402560 00000100:00100000:1.0:1787135918.741518:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616402560 00000100:00100000:1.0:1787135918.741573:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787135918.741595:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:11665:x1873947616402560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787135918.741836:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:11665:x1873947616402560:12345-0@lo:502:llog_process_th.0 Request processed in 254us (2884us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135918.741845:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787135918.742294:0:11665:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874494700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e67bffa2-3749-4eab-9303-62ad12948de4:11665:1873947616402560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787135918.742328:0:11665:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787135918.742336:0:11665:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787135918.742338:0:11665:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787135918.742345:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000040:00080000:0.0:1787135918.744590:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000000:1.0:1787135918.745097:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1787135918.745123:0:5818:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787135918.745134:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135918.745156:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135919.141346:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135919.141604:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595396096 00000100:00100000:1.0:1787135919.141614:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595396096 00000100:00100000:1.0:1787135919.141676:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 261 00000100:00100000:1.0:1787135919.141686:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+11:5600:x1873947595396096:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787135919.141704:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135919.141721:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98533af600/0xf5850c552f20262d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b7181f9 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135919.141780:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98533af600/0xf5850c552f20262d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181f9 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135919.141792:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98533af600/0xf5850c552f20262d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181f9 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135919.141801:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533af600, rc 0) 00000100:00100000:1.0:1787135919.141900:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+12:5600:x1873947595396096:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 215us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135919.141916:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 261 00000100:00100000:1.0:1787135919.154630:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135919.154755:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595396224 00000100:00100000:2.0:1787135919.154765:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595396224 00000100:00100000:2.0:1787135919.154820:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 262 00000100:00100000:2.0:1787135919.154830:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+12:5600:x1873947595396224:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787135919.155190:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+12:5600:x1873947595396224:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 360us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135919.155199:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 262 00000100:00100000:3.0:1787135919.156936:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135919.157155:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595396352 00000100:00100000:2.0:1787135919.157165:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595396352 00000100:00100000:2.0:1787135919.157222:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 263 00000100:00100000:2.0:1787135919.157233:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+12:5600:x1873947595396352:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787135919.157717:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f162850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+12:5600:x1873947595396352:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 485us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135919.157726:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 263 00000100:00100000:0.0:1787135919.162641:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135919.162754:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595396480 00000100:00100000:1.0:1787135919.162764:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595396480 00000100:00100000:1.0:1787135919.162844:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 264 00000100:00100000:1.0:1787135919.162854:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+12:9951:x1873947595396480:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787135919.163622:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+12:9951:x1873947595396480:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 765us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135919.163633:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 264 00000100:00100000:1.0:1787135919.169738:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135919.169837:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595396608 00000100:00100000:2.0:1787135919.169847:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595396608 00000100:00100000:2.0:1787135919.169911:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 265 00000100:00100000:2.0:1787135919.169932:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+12:9951:x1873947595396608:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787135919.170209:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+12:9951:x1873947595396608:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 287us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135919.170217:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 265 00000100:00100000:3.0:1787135919.176357:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135919.177183:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595396736 00000100:00100000:1.0:1787135919.177193:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595396736 00000100:00100000:1.0:1787135919.177250:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 266 00000100:00100000:1.0:1787135919.177259:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984f160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+12:5600:x1873947595396736:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787135919.177282:0:5815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135919.177299:0:5815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98533ae200/0xf5850c552f202634 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b718200 expref: -99 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135919.177343:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98533ae200/0xf5850c552f202634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718200 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135919.177355:0:5815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98533ae200/0xf5850c552f202634 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718200 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135919.177365:0:5815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533ae200, rc 0) 00000100:00100000:1.0:1787135919.177547:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984f160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:5600:x1873947595396736:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 288us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135919.177554:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 266 00000100:00100000:3.0:1787135919.182896:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135919.183096:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595396864 00000100:00100000:0.0:1787135919.183107:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595396864 00000100:00100000:0.0:1787135919.183149:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 267 00000100:00100000:0.0:1787135919.183158:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:5600:x1873947595396864:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787135919.184654:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:5600:x1873947595396864:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 1490us (1760us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135919.184664:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 267 00000100:00100000:3.0:1787135919.187648:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135919.187741:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595396992 00000100:00100000:2.0:1787135919.187751:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595396992 00000100:00100000:2.0:1787135919.187815:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 268 00000100:00100000:2.0:1787135919.187826:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:5600:x1873947595396992:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787135919.188041:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:5600:x1873947595396992:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 215us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135919.188086:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 268 00010000:00010000:0.0:1787135919.193069:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135919.212492:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135919.212824:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595397120 00000100:00100000:1.0:1787135919.212835:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595397120 00000100:00100000:1.0:1787135919.212888:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 269 00000100:00100000:1.0:1787135919.212897:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:9954:x1873947595397120:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787135919.213176:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:9954:x1873947595397120:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 279us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135919.213185:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 269 00000100:00100000:3.0:1787135919.220347:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135919.221688:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595397248 00000100:00100000:0.0:1787135919.221700:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595397248 00000100:00100000:0.0:1787135919.221754:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 270 00000100:00100000:0.0:1787135919.221764:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:9954:x1873947595397248:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787135919.222415:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:9954:x1873947595397248:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 649us (2073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135919.222426:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 270 00000040:00080000:0.0:1787135919.769475:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787135919.975040:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135919.975103:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135919.975135:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135919.975162:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135919.975353:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595397376 00000100:00100000:2.0:1787135919.975363:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595397376 00000100:00100000:2.0:1787135919.975411:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 271 00000100:00100000:2.0:1787135919.975420:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595397376:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135919.975476:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595397504 00000100:00100000:1.0:1787135919.975482:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595397504 00000100:00100000:2.0:1787135919.975490:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595397376:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135919.975498:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 271 00000100:00080000:2.0:1787135919.975539:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135919.975547:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595397760 00000100:00100000:1.0:1787135919.975551:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595397760 00000100:00100000:2.0:1787135919.975561:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:2.0:1787135919.975579:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595397504:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135919.975599:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:2.0:1787135919.975611:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595397504:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 41us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135919.975613:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595397760:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135919.975624:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00080000:2.0:1787135919.975649:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135919.975655:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595397760:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 48us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135919.975675:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:0.0:1787135919.975959:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595397632 00000100:00100000:0.0:1787135919.975964:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595397632 00000100:00100000:0.0:1787135919.976012:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1787135919.976020:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595397632:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135919.976081:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876caea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595397632:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 62us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135919.976088:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00080000:2.0:1787135919.976238:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787135920.216281:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135921.112720:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787135921.122705:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616402816:0@lo:400:kworker.0 00000100:00100000:1.0:1787135921.122791:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135921.123042:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616402816 00000100:00100000:0.0:1787135921.123079:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616402816 00000100:00100000:0.0:1787135921.123124:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787135921.123143:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616402816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135921.123192:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616402816:12345-0@lo:400:kworker.0 Request processed in 49us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135921.123199:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787135921.123502:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616402816:0@lo:400:kworker.0 00000100:00100000:1.0:1787135921.123511:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616402688:0@lo:400:kworker.0 00000100:00100000:1.0:1787135921.123540:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135921.126491:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616402688 00000100:00100000:0.0:1787135921.126507:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616402688 00000100:00100000:0.0:1787135921.126603:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1787135921.126623:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616402688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135921.126753:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616402688:12345-0@lo:400:kworker.0 Request processed in 118us (3196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135921.126762:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1787135921.127229:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616402688:0@lo:400:kworker.0 00000100:00100000:2.0:1787135921.127805:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616403072:0@lo:400:kworker.0 00000100:00100000:2.0:1787135921.129091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135921.129143:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787135921.129157:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616402944:0@lo:400:kworker.0 00000100:00100000:2.0:1787135921.129195:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135921.129240:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616403200:0@lo:400:kworker.0 00000100:00100000:2.0:1787135921.129269:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135921.129297:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787135921.129308:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616403328:0@lo:400:kworker.0 00000100:00100000:2.0:1787135921.129340:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135921.129376:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616402944 00000100:00100000:2.0:1787135921.129383:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616402944 00000100:00100000:2.0:1787135921.129439:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616403200 00000100:00100000:2.0:1787135921.129449:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616403200 00000100:00100000:2.0:1787135921.129478:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787135921.129487:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616402944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135921.129577:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616402944:12345-0@lo:400:kworker.0 Request processed in 90us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135921.129584:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787135921.129600:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787135921.130018:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616403072 00000100:00100000:3.0:1787135921.130023:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616403072 00000100:00100000:3.0:1787135921.130078:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616403328 00000100:00100000:3.0:1787135921.130081:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616403328 00000100:00100000:3.0:1787135921.130104:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787135921.130111:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616403072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135921.130149:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616403072:12345-0@lo:400:kworker.0 Request processed in 39us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135921.130160:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787135921.130171:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787135921.130177:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1873947616403328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135921.130208:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1873947616403328:12345-0@lo:400:kworker.0 Request processed in 31us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135921.130220:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787135921.130266:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616403328:0@lo:400:kworker.0 00000100:00080000:3.0:1787135921.130306:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787135921.130310:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787135921.130312:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135921.130356:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616402944:0@lo:400:kworker.0 00010000:00080000:3.0:1787135921.130393:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987c4c0700 x1873947616403072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135921.130403:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616403072:0@lo:400:kworker.0 00000100:00100000:2.0:1787135921.132403:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616403200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135921.133962:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616403200:12345-0@lo:400:kworker.0 Request processed in 4351us (4686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135921.133973:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787135921.136350:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616403200:0@lo:400:kworker.0 00010000:00010000:1.0:1787135921.243043:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135921.624943:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787135921.624965:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616403456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135921.625069:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135921.629004:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616403584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787135921.629099:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135921.629301:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616403456 00000100:00100000:2.0:1787135921.629309:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616403456 00000100:00100000:2.0:1787135921.629360:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616403584 00000100:00100000:2.0:1787135921.629363:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616403584 00000100:00100000:2.0:1787135921.629381:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787135921.629389:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616403456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787135921.629423:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135921.629469:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616403456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (4400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135921.629476:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787135921.629493:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787135921.629499:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616403584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787135921.629516:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135921.629541:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616403584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135921.629547:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787135921.630280:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616403584:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1787135921.630317:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876cae680 x1873947616403456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135921.630340:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616403456:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1787135922.205890:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:2.0:1787135922.264680:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135923.289433:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135924.312289:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135925.098302:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135925.098350:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135925.098385:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135925.098597:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595397888 00000100:00100000:1.0:1787135925.098608:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595397888 00000100:00100000:1.0:1787135925.098663:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 273 00000100:00100000:1.0:1787135925.098673:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:2362:x1873947595397888:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135925.098727:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595398144 00000100:00100000:2.0:1787135925.098732:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595398144 00000100:00100000:1.0:1787135925.098757:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:2362:x1873947595397888:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 85us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135925.098766:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 273 00000100:00100000:2.0:1787135925.098774:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1787135925.098784:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2362:x1873947595398144:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135925.098814:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595398016 00000100:00100000:0.0:1787135925.098819:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595398016 00000100:00100000:2.0:1787135925.098821:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2362:x1873947595398144:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 39us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135925.098830:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:0.0:1787135925.099071:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:0.0:1787135925.099081:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2361:x1873947595398016:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135925.099111:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2361:x1873947595398016:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 34us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135925.099118:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00080000:3.0:1787135925.100595:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787135925.100605:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787135925.100703:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135925.102086:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595398272 00000100:00100000:0.0:1787135925.102108:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595398272 00000100:00100000:0.0:1787135925.102199:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:0.0:1787135925.102210:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2361:x1873947595398272:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:3.0:1787135925.102501:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135925.102553:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2361:x1873947595398272:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 344us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135925.102561:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 103 00010000:00010000:1.0:1787135925.336551:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135926.232586:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616403840:0@lo:400:kworker.0 00000100:00100000:1.0:1787135926.232685:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135926.232756:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616404352:0@lo:400:kworker.0 00000100:00100000:1.0:1787135926.232803:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135926.233023:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616403840 00000100:00100000:2.0:1787135926.233042:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616403840 00000100:00100000:2.0:1787135926.233101:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787135926.233109:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616403840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135926.233158:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616403840:12345-0@lo:400:kworker.0 Request processed in 50us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135926.233165:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787135926.233259:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616403840:0@lo:400:kworker.0 00000100:00100000:1.0:1787135926.233275:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787135926.233282:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616403712:0@lo:400:kworker.0 00000100:00100000:1.0:1787135926.233318:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135926.233339:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616404224:0@lo:400:kworker.0 00000100:00100000:1.0:1787135926.233360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135926.233386:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616404224 00000100:00100000:1.0:1787135926.233389:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616404224 00000100:00100000:1.0:1787135926.233423:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787135926.233431:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616404224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135926.233465:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616404224:12345-0@lo:400:kworker.0 Request processed in 36us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135926.233473:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1787135926.233490:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135926.233511:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616404224:0@lo:400:kworker.0 00000100:00100000:3.0:1787135926.233661:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616404096:0@lo:400:kworker.0 00000100:00100000:3.0:1787135926.233701:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135926.233728:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787135926.233734:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616403968:0@lo:400:kworker.0 00000100:00100000:3.0:1787135926.233756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135926.233801:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616404352 00000100:00100000:3.0:1787135926.233806:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616404352 00000100:00100000:3.0:1787135926.233848:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616404096 00000100:00100000:3.0:1787135926.233852:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616404096 00000100:00100000:3.0:1787135926.233869:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787135926.233875:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616404352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135926.233911:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616404352:12345-0@lo:400:kworker.0 Request processed in 36us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135926.233917:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787135926.233929:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787135926.233935:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616404096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135926.233965:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616404096:12345-0@lo:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135926.233971:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787135926.233998:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987c4c1500 x1873947616404096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135926.234008:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616404096:0@lo:400:kworker.0 00000100:00080000:1.0:1787135926.234202:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787135926.234205:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787135926.234327:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787135926.234334:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e987c4c3100, transno 4294967300 00000100:00100000:1.0:1787135926.234353:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616404352:0@lo:400:kworker.0 00000100:00100000:2.0:1787135926.234412:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616403712 00000100:00100000:2.0:1787135926.234416:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616403712 00000100:00100000:2.0:1787135926.234449:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787135926.234456:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616403712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135926.234503:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616403712:12345-0@lo:400:kworker.0 Request processed in 47us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135926.234510:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787135926.234547:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616403968 00000100:00100000:2.0:1787135926.234551:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616403968 00000100:00100000:2.0:1787135926.234580:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787135926.234587:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616403968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135926.234619:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616403968:12345-0@lo:400:kworker.0 Request processed in 33us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135926.234625:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:2.0:1787135926.234639:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135926.234655:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616403968:0@lo:400:kworker.0 00000100:00100000:0.0:1787135926.234758:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616403712:0@lo:400:kworker.0 00010000:00010000:2.0:1787135926.360346:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135926.748163:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98738d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616404480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787135926.748254:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135926.749186:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616404480 00000100:00100000:3.0:1787135926.749195:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616404480 00000100:00100000:3.0:1787135926.749240:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787135926.749248:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616404480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787135926.749281:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135926.749296:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787135926.749306:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616404608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787135926.749324:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616404480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135926.749332:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787135926.749332:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135926.749346:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616404608 00000100:00100000:3.0:1787135926.749349:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616404608 00010000:00080000:2.0:1787135926.749372:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98738d8e00 x1873947616404480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135926.749376:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787135926.749381:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616404608:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135926.749395:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98738d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616404480:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787135926.749398:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135926.749429:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616404608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135926.749435:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787135926.749455:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616404608:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787135927.384848:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135928.408294:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135929.432876:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787135930.009982:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787135930.214760:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135930.214809:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135930.214840:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135930.214874:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135930.214907:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595398528 00000100:00100000:3.0:1787135930.214917:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595398528 00000100:00100000:3.0:1787135930.214970:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595398784 00000100:00100000:3.0:1787135930.214973:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595398784 00000100:00100000:3.0:1787135930.214994:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:3.0:1787135930.215004:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595398528:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135930.215104:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595398528:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 101us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135930.215111:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:3.0:1787135930.215128:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:3.0:1787135930.215135:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595398784:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135930.215160:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595398784:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135930.215166:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:2.0:1787135930.215260:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595398656 00000100:00100000:2.0:1787135930.215264:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595398656 00000100:00100000:2.0:1787135930.215299:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:2.0:1787135930.215307:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595398656:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135930.215347:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595398656:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 41us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135930.215353:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00080000:2.0:1787135930.215369:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787135930.215373:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135930.215815:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595398400 00000100:00100000:0.0:1787135930.215821:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595398400 00000100:00100000:0.0:1787135930.215857:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 275 00000100:00100000:0.0:1787135930.215864:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595398400:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135930.215896:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595398400:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 32us (1144us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135930.215903:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 275 00010000:00010000:2.0:1787135930.456696:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135931.353278:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616404992:0@lo:400:kworker.0 00000100:00100000:1.0:1787135931.353342:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135931.353416:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787135931.353423:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616405120:0@lo:400:kworker.0 00000100:00100000:1.0:1787135931.353447:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135931.353486:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616405120 00000100:00100000:1.0:1787135931.353502:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616405120 00000100:00100000:0.0:1787135931.353516:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616404864:0@lo:400:kworker.0 00000100:00100000:0.0:1787135931.353546:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135931.353557:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787135931.353561:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616405376:0@lo:400:kworker.0 00000100:00100000:1.0:1787135931.353566:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616405120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135931.353579:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135931.353598:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787135931.353602:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616404736:0@lo:400:kworker.0 00000100:00100000:1.0:1787135931.353614:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616405120:12345-0@lo:400:kworker.0 Request processed in 50us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135931.353621:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787135931.353624:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135931.353635:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616405376 00000100:00100000:1.0:1787135931.353638:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616405376 00000100:00100000:0.0:1787135931.353649:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616405248:0@lo:400:kworker.0 00000100:00100000:1.0:1787135931.353660:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787135931.353668:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135931.353690:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616404736 00000100:00100000:0.0:1787135931.353693:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616404736 00000100:00100000:0.0:1787135931.353719:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787135931.353725:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616404736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135931.353758:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616404736:12345-0@lo:400:kworker.0 Request processed in 33us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135931.353770:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1787135931.353834:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616404736:0@lo:400:kworker.0 00000100:00100000:2.0:1787135931.353843:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616404992 00000100:00100000:2.0:1787135931.353847:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616404992 00000100:00100000:2.0:1787135931.353872:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616404864 00000100:00100000:2.0:1787135931.353875:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616404864 00010000:00080000:0.0:1787135931.353883:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e98533aa680 x1873947616405120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135931.353886:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616405248 00000100:00100000:2.0:1787135931.353888:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616405248 00000100:00100000:0.0:1787135931.353895:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616405120:0@lo:400:kworker.0 00000100:00100000:2.0:1787135931.353900:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787135931.353906:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616404992:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787135931.353917:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787135931.353921:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787135931.353923:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787135931.353934:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787135931.353941:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616404864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135931.353943:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616404992:12345-0@lo:400:kworker.0 Request processed in 38us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135931.353949:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787135931.353972:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787135931.353972:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616404864:12345-0@lo:400:kworker.0 Request processed in 32us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135931.353977:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616405248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135931.353978:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787135931.354000:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616404864:0@lo:400:kworker.0 00000100:00100000:2.0:1787135931.354008:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616405248:12345-0@lo:400:kworker.0 Request processed in 31us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135931.354013:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616405248:0@lo:400:kworker.0 00000100:00100000:2.0:1787135931.354014:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787135931.354042:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616404992:0@lo:400:kworker.0 00000100:00100000:1.0:1787135931.354148:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987482a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616405376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135931.354825:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987482a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616405376:12345-0@lo:400:kworker.0 Request processed in 1158us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135931.354834:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787135931.354923:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616405376:0@lo:400:kworker.0 00010000:00010000:0.0:1787135931.480788:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135931.864428:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787135931.864451:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616405632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787135931.864527:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135931.864596:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616405504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787135931.864619:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135931.864709:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616405632 00000100:00100000:3.0:1787135931.864717:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616405632 00000100:00100000:3.0:1787135931.864778:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616405504 00000100:00100000:3.0:1787135931.864782:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616405504 00000100:00100000:3.0:1787135931.864797:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787135931.864806:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616405632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787135931.864851:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135931.864894:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616405632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135931.864901:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787135931.864917:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787135931.864923:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616405504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787135931.864940:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135931.864965:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616405504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135931.864971:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1787135931.865169:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987497bb80 x1873947616405632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135931.865198:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616405632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787135931.865212:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616405504:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787135932.506852:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135933.528287:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135934.555118:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135935.333000:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135935.333141:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595398912 00000100:00100000:2.0:1787135935.333152:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595398912 00000100:00100000:2.0:1787135935.333212:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 277 00000100:00100000:2.0:1787135935.333224:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595398912:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135935.333300:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595398912:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 78us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135935.333309:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 277 00000100:00100000:3.0:1787135935.335033:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135935.335164:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595399040 00000100:00100000:0.0:1787135935.335174:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595399040 00000100:00100000:0.0:1787135935.335248:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 112 00000100:00100000:0.0:1787135935.335260:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595399040:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135935.335333:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595399040:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 75us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135935.335358:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 112 00000100:00080000:2.0:1787135935.335476:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135935.362670:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135935.362787:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595399168 00000100:00100000:0.0:1787135935.362797:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595399168 00000100:00100000:0.0:1787135935.362870:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:0.0:1787135935.362880:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2358:x1873947595399168:12345-192.168.203.38@tcp:9:kworker.0 00000020:00000080:0.0:1787135935.362910:0:6673:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202570 00000100:00080000:0.0:1787135935.362919:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8e987486a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787135935.362962:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1787135935.363453:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787135935.363755:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+2:2358:x1873947595399168:12345-192.168.203.38@tcp:9:kworker.0 Request processed in 875us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135935.363865:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00010000:00010000:3.0:1787135935.364026:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135935.364164:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135935.364765:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595399296 00000100:00100000:3.0:1787135935.364785:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595399296 00000100:00100000:3.0:1787135935.364846:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:3.0:1787135935.364856:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595399296:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135935.364911:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595399296:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 57us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135935.364918:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00080000:0.0:1787135935.365732:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787135935.576310:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135936.472319:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616405760:0@lo:400:kworker.0 00000100:00100000:1.0:1787135936.472405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135936.472584:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616406016:0@lo:400:kworker.0 00000100:00100000:2.0:1787135936.472619:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135936.472689:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1787135936.472696:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616405888:0@lo:400:kworker.0 00000100:00100000:2.0:1787135936.472719:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135936.472738:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616406400:0@lo:400:kworker.0 00000100:00100000:2.0:1787135936.472761:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135936.472805:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616406016 00000100:00100000:2.0:1787135936.472813:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616406016 00000100:00100000:2.0:1787135936.472862:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616405888 00000100:00100000:2.0:1787135936.472872:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616405888 00000100:00100000:2.0:1787135936.472895:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787135936.472904:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616406016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135936.472957:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616406016:12345-0@lo:400:kworker.0 Request processed in 53us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135936.472964:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787135936.472979:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1787135936.472986:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616405888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135936.473009:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616405888:12345-0@lo:400:kworker.0 Request processed in 24us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135936.473015:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1787135936.473028:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135936.473076:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616405888:0@lo:400:kworker.0 00000100:00100000:2.0:1787135936.473087:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616406016:0@lo:400:kworker.0 00000100:00100000:1.0:1787135936.474608:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616406272:0@lo:400:kworker.0 00000100:00100000:1.0:1787135936.474655:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135936.474678:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787135936.474685:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616406144:0@lo:400:kworker.0 00000100:00100000:1.0:1787135936.474709:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135936.474740:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616406400 00000100:00100000:1.0:1787135936.474746:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616406400 00000100:00100000:1.0:1787135936.474790:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616406144 00000100:00100000:1.0:1787135936.474793:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616406144 00000100:00100000:1.0:1787135936.474816:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787135936.474824:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616406400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135936.474872:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616406400:12345-0@lo:400:kworker.0 Request processed in 49us (2109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135936.474879:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787135936.474894:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787135936.474901:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616406144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135936.474934:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616406144:12345-0@lo:400:kworker.0 Request processed in 34us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135936.474940:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1787135936.474955:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787135936.474958:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787135936.474982:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616406400:0@lo:400:kworker.0 00000100:00100000:1.0:1787135936.475002:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616406272 00000100:00100000:1.0:1787135936.475005:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616406272 00000100:00100000:1.0:1787135936.475031:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787135936.475038:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616406272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135936.475096:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616406272:12345-0@lo:400:kworker.0 Request processed in 58us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135936.475102:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1787135936.475117:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787135936.475133:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987c2f5500 x1873947616406144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135936.475143:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616406144:0@lo:400:kworker.0 00000100:00100000:1.0:1787135936.475152:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616406272:0@lo:400:kworker.0 00000100:00100000:0.0:1787135936.479566:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616405760 00000100:00100000:0.0:1787135936.479583:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616405760 00000100:00100000:0.0:1787135936.479654:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787135936.479665:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616405760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135936.479760:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616405760:12345-0@lo:400:kworker.0 Request processed in 98us (7355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135936.479768:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787135936.480084:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616405760:0@lo:400:kworker.0 00010000:00010000:3.0:1787135936.600224:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135936.985765:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987497b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616406528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787135936.985840:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135936.985967:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616406528 00000100:00100000:0.0:1787135936.985975:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616406528 00000100:00100000:2.0:1787135936.986002:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616406656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135936.986030:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787135936.986038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135936.986043:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616406528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787135936.986099:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135936.986105:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616406656 00000100:00100000:2.0:1787135936.986110:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616406656 00000100:00100000:2.0:1787135936.986133:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787135936.986141:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616406656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787135936.986160:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135936.986200:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616406656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135936.986209:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787135936.986240:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616406656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135936.986572:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616406528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 533us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135936.986597:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1787135936.986945:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987497b800 x1873947616406528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135936.986962:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987497b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616406528:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787135937.544185:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000020:00000080:0.0:1787135937.544194:0:7625:0:(genops.c:906:class_export_put()) final put ffff8e987486c800/a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000020:00000080:2.0:1787135937.544298:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e987486c800/a1006dc5-9c90-4762-af1c-1ab0be9a05b8 for lustre-OST0001 00000020:00000080:2.0:1787135937.544358:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e987486a000 for lustre-OST0001 00010000:00010000:2.0:1787135937.624509:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135938.406526:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135938.406571:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135938.406661:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135938.406690:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595399552 00000100:00100000:1.0:1787135938.406700:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595399552 00000100:00100000:1.0:1787135938.406902:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595399680 00000100:00100000:1.0:1787135938.406906:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595399680 00000100:00100000:1.0:1787135938.406940:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:1.0:1787135938.406950:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595399552:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135938.407963:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595399424 00000100:00100000:2.0:1787135938.407971:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595399424 00000100:00100000:2.0:1787135938.408018:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 279 00000100:00100000:2.0:1787135938.408027:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595399424:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135938.408094:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595399424:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 68us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135938.408102:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 279 00000100:00100000:2.0:1787135938.408139:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:2.0:1787135938.408146:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595399680:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135938.408172:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595399680:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135938.408179:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00080000:2.0:1787135938.408227:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135938.408238:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595399552:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 156us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135938.408254:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 117 00010000:00010000:1.0:1787135938.648790:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135939.672454:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787135940.254556:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1787135940.454314:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135940.454384:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135940.454423:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135940.454464:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595400064 00000100:00100000:3.0:1787135940.454473:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595400064 00000100:00100000:3.0:1787135940.454526:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595399936 00000100:00100000:3.0:1787135940.454530:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595399936 00000100:00100000:3.0:1787135940.454553:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:3.0:1787135940.454563:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595400064:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135940.454626:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595400064:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 64us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135940.454634:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:3.0:1787135940.454649:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:3.0:1787135940.454656:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595399936:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135940.454679:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595399936:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135940.454685:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00080000:3.0:1787135940.454699:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135940.454864:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595399808 00000100:00100000:1.0:1787135940.454879:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595399808 00000100:00100000:1.0:1787135940.454915:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 280 00000100:00100000:1.0:1787135940.454923:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595399808:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135940.454949:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595399808:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 28us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135940.454954:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 280 00010000:00010000:1.0:1787135940.700656:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787135941.465201:0:11832:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 06:38:59 (1787135939) 00000100:00100000:1.0:1787135941.598005:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616407040:0@lo:400:kworker.0 00000100:00100000:1.0:1787135941.598091:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135941.598148:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787135941.598156:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616406912:0@lo:400:kworker.0 00000100:00100000:1.0:1787135941.598179:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135941.598195:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616407424:0@lo:400:kworker.0 00000100:00100000:1.0:1787135941.598218:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135941.598253:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616407424 00000100:00100000:1.0:1787135941.598260:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616407424 00000100:00100000:1.0:1787135941.598312:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787135941.598323:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616407424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135941.598376:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616407424:12345-0@lo:400:kworker.0 Request processed in 55us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135941.598383:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787135941.598454:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616407424:0@lo:400:kworker.0 00000100:00100000:2.0:1787135941.598651:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616406784:0@lo:400:kworker.0 00000100:00100000:2.0:1787135941.598685:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135941.598720:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616407296:0@lo:400:kworker.0 00000100:00100000:2.0:1787135941.598743:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135941.598760:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787135941.598765:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616407168:0@lo:400:kworker.0 00000100:00100000:2.0:1787135941.598798:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135941.599103:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616406784 00000100:00100000:1.0:1787135941.599108:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616406784 00000100:00100000:1.0:1787135941.599135:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787135941.599142:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616406784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135941.599181:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616406784:12345-0@lo:400:kworker.0 Request processed in 39us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135941.599187:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787135941.599213:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616407040 00000100:00100000:1.0:1787135941.599217:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616407040 00000100:00100000:1.0:1787135941.599242:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616406912 00000100:00100000:1.0:1787135941.599246:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616406912 00000100:00100000:1.0:1787135941.599258:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616407296 00000100:00100000:1.0:1787135941.599260:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616407296 00000100:00100000:1.0:1787135941.599274:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787135941.599281:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616407040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135941.599316:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616407040:12345-0@lo:400:kworker.0 Request processed in 35us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135941.599322:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1787135941.599334:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787135941.599340:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616406912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135941.599367:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616406912:12345-0@lo:400:kworker.0 Request processed in 28us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135941.599373:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787135941.599384:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787135941.599390:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616407296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135941.599414:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616407296:12345-0@lo:400:kworker.0 Request processed in 25us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135941.599444:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787135941.599477:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616406784:0@lo:400:kworker.0 00000100:00100000:1.0:1787135941.599488:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616407296:0@lo:400:kworker.0 00000100:00100000:1.0:1787135941.599638:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616406912:0@lo:400:kworker.0 00000100:00100000:1.0:1787135941.599649:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616407040:0@lo:400:kworker.0 00000100:00080000:2.0:1787135941.601371:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787135941.601379:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787135941.601401:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616407168 00000100:00100000:2.0:1787135941.601415:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616407168 00000100:00100000:2.0:1787135941.601478:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787135941.601487:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616407168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135941.601562:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616407168:12345-0@lo:400:kworker.0 Request processed in 76us (2762us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135941.601571:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1787135941.601861:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787135941.601893:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987c0d5180 x1873947616407168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787135957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135941.601905:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616407168:0@lo:400:kworker.0 00010000:00010000:3.0:1787135941.720160:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135942.104519:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616407552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787135942.104593:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135942.104824:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787135942.104834:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616407680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135942.104860:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135942.104888:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616407552 00000100:00100000:2.0:1787135942.104895:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616407552 00000100:00100000:2.0:1787135942.104936:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616407680 00000100:00100000:2.0:1787135942.104939:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616407680 00000100:00100000:2.0:1787135942.104955:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787135942.104962:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616407552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787135942.104992:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135942.105029:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616407552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135942.105036:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787135942.105070:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787135942.105076:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616407680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787135942.105092:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135942.105130:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616407680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135942.105135:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1787135942.105172:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e987c2f7100 x1873947616407680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787135958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787135942.105410:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616407680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135942.105454:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616407552:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787135942.744712:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135943.161606:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135943.161710:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595400192 00000100:00100000:1.0:1787135943.161720:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595400192 00000100:00100000:1.0:1787135943.161796:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:1.0:1787135943.161808:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:10224:x1873947595400192:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787135943.161830:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135943.161851:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f20263b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718207 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.161914:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f202642 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.161928:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f202642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.161966:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f202642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135943.162196:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787135943.162200:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787135943.162317:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f202642 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.162343:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f20263b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718207 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.162369:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f202642 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718207 expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.162378:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9853809300) 00010000:00010000:1.0:1787135943.162380:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787135943.162383:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533afc00, rc 0) 00000100:00100000:1.0:1787135943.162448:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:10224:x1873947595400192:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 644us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135943.162456:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00080000:2.0:1787135943.163097:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135943.172224:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135943.172739:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595400320 00000100:00100000:2.0:1787135943.172750:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595400320 00000100:00100000:2.0:1787135943.172814:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:2.0:1787135943.172825:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:10225:x1873947595400320:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787135943.172845:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135943.172870:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71820e expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.172939:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202650 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.172965:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202650 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.172976:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202650 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.172990:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202657 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.172997:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202657 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173003:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202657 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173457:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f20265e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173467:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f20265e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173475:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f20265e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135943.173554:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787135943.173558:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135943.173655:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f20265e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173667:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202650 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173674:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202650 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173680:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202650 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173686:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135943.173690:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202650 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173698:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202650 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173710:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9853809300) 00010000:00010000:2.0:1787135943.173717:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135943.173723:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202650 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173729:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202650 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173741:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202657 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173747:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202657 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173753:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202657 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173758:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135943.173761:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202657 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173766:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202657 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173774:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e98532d1d00) 00010000:00010000:2.0:1787135943.173776:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135943.173779:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202657 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173785:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202657 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173812:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71820e expref: 8 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173835:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f20265e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71820e expref: 7 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135943.173843:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e98532d1800) 00010000:00010000:2.0:1787135943.173845:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787135943.173847:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7200, rc 0) 00000100:00100000:2.0:1787135943.175098:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:10225:x1873947595400320:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 2267us (2876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135943.175110:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:3.0:1787135943.187787:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135943.188956:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595400576 00000100:00100000:1.0:1787135943.188970:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595400576 00000100:00100000:1.0:1787135943.189029:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:1.0:1787135943.189040:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:10225:x1873947595400576:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787135943.189104:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135943.189123:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202665 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718215 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.189210:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f20266c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.189223:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f20266c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.189234:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f20266c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.189304:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202673 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.189313:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202673 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.189321:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202673 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.190082:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af000/0xf5850c552f20267a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.190094:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af000/0xf5850c552f20267a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.190101:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af000/0xf5850c552f20267a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135943.190111:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1787135943.190306:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f20266c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.190314:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f20266c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.190325:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f20266c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.190331:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aea00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135943.190335:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f20266c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.190342:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f20266c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.190354:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e98532d1800) 00010000:00010000:1.0:1787135943.190358:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135943.190362:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f20266c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.190368:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f20266c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.190380:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202673 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.191606:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202673 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.191616:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202673 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.191622:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aee00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135943.191626:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202673 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.191647:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202673 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.191660:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e9853809900) 00010000:00010000:1.0:1787135943.191663:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135943.191667:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202673 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135943.191673:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202673 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135943.193278:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202665 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718215 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135943.193301:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af000/0xf5850c552f20267a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718215 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135943.193311:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9853809600) 00010000:00010000:0.0:1787135943.193314:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135943.193317:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533af000, rc 0) 00000100:00100000:0.0:1787135943.193550:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:10225:x1873947595400576:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 4510us (5773us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1787135943.193558:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:1.0:1787135943.201190:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135943.201260:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595400704 00000100:00100000:2.0:1787135943.201270:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595400704 00000100:00100000:2.0:1787135943.201330:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:2.0:1787135943.201349:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:10225:x1873947595400704:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787135943.201469:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:10225:x1873947595400704:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 Request processed in 121us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135943.201476:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000040:00080000:1.0:1787135943.326922:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787135943.769854:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135944.792309:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135945.216383:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135945.216430:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595400832 00000100:00100000:3.0:1787135945.216439:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595400832 00000100:00100000:3.0:1787135945.216499:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:3.0:1787135945.216510:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987497bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:10267:x1873947595400832:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135945.216771:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135945.216792:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71821c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.216857:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20268f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.216870:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20268f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.216883:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20268f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.216896:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f202696 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.216903:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f202696 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.216909:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f202696 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217167:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20268f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217186:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20268f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217191:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20268f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217197:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511da000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135945.217202:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20268f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217220:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20268f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217241:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9853809300) 00010000:00010000:3.0:1787135945.217245:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135945.217250:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20268f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217256:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20268f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217268:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f202696 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217274:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f202696 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217279:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f202696 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217284:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135945.217287:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f202696 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217292:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f202696 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217299:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e9843179300) 00010000:00010000:3.0:1787135945.217302:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135945.217304:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f202696 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217320:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f202696 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217352:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202688 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71821c expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217362:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9853809300) 00010000:00010000:3.0:1787135945.217364:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135945.217368:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71821c expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.217377:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db600, rc 0) 00000100:00100000:3.0:1787135945.217446:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987497bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:10267:x1873947595400832:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 938us (1072us total) trans 0 rc 301/301 00000100:00100000:3.0:1787135945.217453:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00080000:3.0:1787135945.217479:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135945.223823:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135945.223895:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595401088 00000100:00100000:3.0:1787135945.223905:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595401088 00000100:00100000:3.0:1787135945.223962:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:3.0:1787135945.223972:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:10267:x1873947595401088:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:3.0:1787135945.224026:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135945.224128:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f202642 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718207 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.224146:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9853809300) 00010000:00010000:3.0:1787135945.224156:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787135945.224496:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20269d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.224509:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20269d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.224518:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20269d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.224529:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026a4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.224537:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.224543:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135945.228539:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787135945.228559:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20269d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.228570:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20269d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.228578:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20269d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.228584:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135945.228589:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20269d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.228596:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20269d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.228627:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:3.0:1787135945.228630:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135945.228636:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20269d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.228641:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20269d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787135945.228662:0:5823:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000029c0a61f reply state 00000000a7ca7455 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135945.228670:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787135945.228847:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:10267:x1873947595401088:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 4872us (5029us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787135945.228856:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00010000:00010000:0.0:1787135945.232276:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.232295:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026a4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.232303:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.232310:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135945.232329:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.232337:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026a4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.232363:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e9843179500) 00010000:00010000:0.0:1787135945.232366:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135945.232371:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026a4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.232378:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026a4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135945.322505:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135945.322827:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595401216 00000100:00100000:3.0:1787135945.322837:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595401216 00000100:00100000:3.0:1787135945.322899:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:3.0:1787135945.322909:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:10275:x1873947595401216:12345-192.168.203.38@tcp:101:lctl.0 00010000:00010000:3.0:1787135945.322932:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135945.322954:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f2026ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718223 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.323022:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f2026b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.323036:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f2026b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.323166:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f2026b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135945.323226:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787135945.323230:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787135945.323350:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f2026b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.323376:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f2026ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718223 expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.323394:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f2026b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718223 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.323414:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:3.0:1787135945.323417:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787135945.323420:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da000, rc 0) 00000100:00100000:3.0:1787135945.324611:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:10275:x1873947595401216:12345-192.168.203.38@tcp:101:lctl.0 Request processed in 1697us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135945.324622:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:3.0:1787135945.377136:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135945.377201:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595401344 00000100:00100000:2.0:1787135945.377210:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595401344 00000100:00100000:2.0:1787135945.377268:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:2.0:1787135945.377278:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:10281:x1873947595401344:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1787135945.377297:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135945.377316:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2026b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71822a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377375:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2026c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377413:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2026c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377425:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2026c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377439:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2026c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377446:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2026c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377452:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2026c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377614:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2026ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377623:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2026ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377630:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2026ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135945.377661:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787135945.377664:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135945.377702:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2026ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377713:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2026c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377729:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2026c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377735:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2026c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377741:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135945.377746:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2026c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377753:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2026c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377765:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:2.0:1787135945.377768:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135945.377772:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2026c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377778:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2026c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377790:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2026c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377796:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2026c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377801:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2026c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377806:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135945.377813:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2026c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.377819:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2026c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.379007:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e98532d1d00) 00010000:00010000:2.0:1787135945.379016:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135945.379022:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2026c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.379030:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2026c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.379090:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2026b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71822a expref: 12 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.379104:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2026ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71822a expref: 11 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.379112:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135945.379114:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787135945.379116:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6600, rc 0) 00000100:00100000:2.0:1787135945.379194:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+11:10281:x1873947595401344:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1916us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135945.379204:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:2.0:1787135945.380927:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135945.381008:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595401600 00000100:00100000:3.0:1787135945.381015:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595401600 00000100:00100000:3.0:1787135945.381129:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:3.0:1787135945.381140:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+11:10281:x1873947595401600:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1787135945.381169:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135945.381190:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f2026d5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718231 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.381570:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2026dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.381585:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2026dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.381596:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2026dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.381656:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.381665:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.381671:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787135945.382306:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787135945.382469:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2026ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.382480:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2026ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.382489:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2026ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.382550:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2026dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.382567:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2026dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.382573:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2026dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.382579:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511dac00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135945.382584:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2026dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.382591:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2026dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.382604:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:3.0:1787135945.382606:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135945.382610:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2026dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.382616:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2026dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787135945.382629:0:5821:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000ce75a63c reply state 000000008e534e99 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135945.382637:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787135945.382665:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f2026d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718231 expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.382675:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2026ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718231 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.382688:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9843179000) 00010000:00010000:3.0:1787135945.382690:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787135945.382692:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dbe00, rc 0) 00000100:00100000:3.0:1787135945.382844:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:10281:x1873947595401600:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1704us (1922us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787135945.382852:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00010000:00010000:1.0:1787135945.384854:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.384870:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.384878:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.384883:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135945.384888:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.384896:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.384910:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9843179600) 00010000:00010000:1.0:1787135945.384925:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135945.384929:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.384936:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2026e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135945.386202:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135945.386364:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595401728 00000100:00100000:1.0:1787135945.386373:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595401728 00000100:00100000:1.0:1787135945.386421:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:1.0:1787135945.386429:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1873947595401728:12345-192.168.203.38@tcp:8:bash.0 00010000:00080000:1.0:1787135945.386458:0:6673:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp t0 exp 0000000000000000 cur 305 last 0 00000020:00000080:1.0:1787135945.386482:0:6673:0:(genops.c:1406:class_connect()) connect: client a1006dc5-9c90-4762-af1c-1ab0be9a05b8, cookie 0xf5850c552f2026f8 00002000:00100000:1.0:1787135945.386491:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a1006dc5-9c90-4762-af1c-1ab0be9a05b8/ffff8e9876b37000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113908 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787135945.386509:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787135945.386715:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787135945.386743:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8e9876b32800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787135945.386811:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2358:x1873947595401728:12345-192.168.203.38@tcp:8:bash.0 Request processed in 380us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135945.386819:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:0.0:1787135945.387965:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135945.388194:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595401856 00000100:00100000:1.0:1787135945.388202:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595401856 00000100:00080000:3.0:1787135945.388223:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787135945.388254:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:1.0:1787135945.388314:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:0:x1873947595401856:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1787135945.388326:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135945.388344:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2026ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718238 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787135945.388378:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787135945.388391:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=305s v=(0 0) 00010000:00010000:1.0:1787135945.388394:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787135945.388413:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2026ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718238 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.388428:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2026ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718238 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.388437:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533af400, rc 0) 00000100:00100000:1.0:1787135945.388521:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:0:x1873947595401856:12345-192.168.203.38@tcp:101:bash.0 Request processed in 260us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135945.388526:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:3.0:1787135945.390827:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135945.390926:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595401984 00000100:00100000:2.0:1787135945.390935:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595401984 00000100:00100000:2.0:1787135945.390996:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:2.0:1787135945.391005:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:10281:x1873947595401984:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1787135945.391019:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135945.391037:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71823f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.391092:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2026ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718238 expref: 8 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.391102:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135945.391106:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135945.391112:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.391143:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2026ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718238 expref: 8 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.391156:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2026ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718238 expref: 8 pid: 6672 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135945.391172:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6674:1873947616407808:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135945.391258:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98432fc240 going to sleep for 11 seconds 00000100:00100000:3.0:1787135945.393812:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6674:1873947616407808:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135945.393857:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.393877:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6e00, rc 0) 00000100:00100000:3.0:1787135945.394132:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:10281:x1873947595401984:12345-192.168.203.38@tcp:101:bash.0 Request processed in 3127us (3311us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135945.394142:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:0.0:1787135945.394272:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135945.394412:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595402112 00000100:00100000:2.0:1787135945.394420:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595402112 00010000:00010000:2.0:1787135945.394453:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2026ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718238 expref: 8 pid: 6672 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135945.394500:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:2.0:1787135945.394508:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2359:x1873947595402112:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135945.394519:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135945.394540:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2026ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718238 expref: 8 pid: 6672 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.394552:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2026ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718238 expref: 8 pid: 6672 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.394576:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2026ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718238 expref: 8 pid: 6672 timeout: 405 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.394591:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135945.394595:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135945.394602:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.394617:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.394647:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135945.394659:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873947616407936:192.168.203.38@tcp:105: 00000100:00100000:2.0:1787135945.394727:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98432fc900 going to sleep for 11 seconds 00000100:00100000:2.0:1787135945.396929:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5807:1873947616407936:192.168.203.38@tcp:105: 00010000:00010000:2.0:1787135945.396954:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135945.397013:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2359:x1873947595402112:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 2505us (2740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135945.397024:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:2.0:1787135945.397538:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135945.397580:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595402368 00000100:00100000:0.0:1787135945.397586:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595402368 00000100:00100000:0.0:1787135945.397638:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:0.0:1787135945.397646:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:10281:x1873947595402368:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:0.0:1787135945.398009:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:10281:x1873947595402368:12345-192.168.203.38@tcp:35:bash.0 Request processed in 361us (469us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787135945.398017:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:1.0:1787135945.438121:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135945.438195:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595402624 00000100:00100000:3.0:1787135945.438205:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595402624 00000100:00100000:3.0:1787135945.438259:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1787135945.438270:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:10291:x1873947595402624:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135945.438294:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135945.438314:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20270d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718246 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135945.438436:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787135945.438624:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20270d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718246 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.438641:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:3.0:1787135945.438644:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787135945.438650:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20270d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718246 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.438664:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db600, rc 0) 00000100:00100000:3.0:1787135945.438720:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:10291:x1873947595402624:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 452us (607us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1787135945.438728:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1787135945.440700:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135945.440755:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595402880 00000100:00100000:1.0:1787135945.440855:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595402880 00000100:00100000:1.0:1787135945.440898:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1787135945.440904:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:10291:x1873947595402880:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1787135945.441108:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:10291:x1873947595402880:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 204us (416us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787135945.441113:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1787135945.491510:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135945.491833:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595403008 00000100:00100000:0.0:1787135945.491843:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595403008 00000100:00100000:0.0:1787135945.491903:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:0.0:1787135945.491913:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:10297:x1873947595403008:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1787135945.491935:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135945.491966:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f20271b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71824d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.492028:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.492041:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.492085:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135945.492152:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787135945.492156:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787135945.492182:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.492207:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f20271b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71824d expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.492223:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71824d expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.492231:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:0.0:1787135945.492233:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787135945.492237:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896e00, rc 0) 00000100:00100000:0.0:1787135945.492301:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+17:10297:x1873947595403008:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 390us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135945.492308:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:3.0:1787135945.496538:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135945.496611:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595403264 00000100:00100000:2.0:1787135945.496622:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595403264 00000100:00100000:2.0:1787135945.496684:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:2.0:1787135945.496695:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+17:10297:x1873947595403264:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135945.496714:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135945.496734:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202729 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718254 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.496824:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202730 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.496840:0:7623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2026ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718231 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.496849:0:7623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202730 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.496882:0:7623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2026ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718231 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.496914:0:7623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2026ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718231 expref: 18 pid: 5821 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135945.496928:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616408064:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135945.497016:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98432fc900 going to sleep for 11 seconds 00000100:00100000:3.0:1787135945.499695:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135945.500227:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616408064:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135945.500253:0:7623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202730 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135945.500890:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595403392 00000100:00100000:0.0:1787135945.500914:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595403392 00010000:00010000:0.0:1787135945.500954:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2026ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718231 expref: 19 pid: 5821 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135945.501000:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:0.0:1787135945.501011:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:2360:x1873947595403392:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135945.501028:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135945.501035:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2026ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718231 expref: 19 pid: 5821 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.501067:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2026ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718231 expref: 19 pid: 5821 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.501089:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2026ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718231 expref: 19 pid: 5821 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.501104:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9843179000) 00010000:00010000:0.0:1787135945.501109:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202730 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.501117:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202730 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.501125:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202730 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.501158:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135945.501217:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:2360:x1873947595403392:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 208us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135945.501233:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00010000:00010000:3.0:1787135945.501307:0:7623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202730 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.501316:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202730 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135945.501334:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787135945.501479:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202729 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718254 expref: 19 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.501494:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202730 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718254 expref: 18 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.501501:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9843179000) 00010000:00010000:3.0:1787135945.501509:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787135945.501512:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7000, rc 0) 00000100:00100000:3.0:1787135945.501538:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:10297:x1873947595403264:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 4845us (5008us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787135945.501544:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:1.0:1787135945.508739:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135945.508848:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595403648 00000100:00100000:0.0:1787135945.508857:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595403648 00000100:00100000:0.0:1787135945.508914:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:0.0:1787135945.508924:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:10297:x1873947595403648:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1787135945.508947:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135945.509079:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787135945.509110:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202730 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718254 expref: 18 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.509129:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e9843179000) 00010000:00010000:0.0:1787135945.509139:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787135945.509154:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f20273e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71825b expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.509239:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202745 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.509253:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.509338:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135945.509353:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787135945.509477:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f20273e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71825b expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.509899:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202745 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71825b expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.509908:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1200) 00010000:00010000:0.0:1787135945.509911:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787135945.509913:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896a00, rc 0) 00000100:00100000:1.0:1787135945.511189:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:10297:x1873947595403648:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2258us (2450us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787135945.511227:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:1.0:1787135945.515681:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135945.516014:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595403776 00000100:00100000:3.0:1787135945.516024:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595403776 00000100:00100000:3.0:1787135945.516269:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:3.0:1787135945.516281:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:10297:x1873947595403776:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135945.516305:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135945.516324:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202753 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718262 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.516381:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718262 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.516409:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718262 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.516429:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1200) 00010000:00010000:3.0:1787135945.516433:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135945.516436:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dac00, rc 0) 00000100:00100000:3.0:1787135945.516572:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:10297:x1873947595403776:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 294us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135945.516579:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:3.0:1787135945.521028:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135945.521422:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595403904 00000100:00100000:1.0:1787135945.521432:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595403904 00000100:00100000:1.0:1787135945.521493:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:1.0:1787135945.521503:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2359:x1873947595403904:12345-192.168.203.38@tcp:1:lfs.0 00010000:00010000:1.0:1787135945.521543:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.521561:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.521570:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787135945.521574:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787135945.521579:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.521615:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.521645:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 7 pid: 6674 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135945.521661:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1873947616408192:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787135945.521912:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2000 going to sleep for 11 seconds 00000100:00100000:1.0:1787135945.525473:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135945.525588:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0d4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1873947616408192:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135945.525615:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135945.527744:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595404032 00000100:00100000:0.0:1787135945.527757:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595404032 00002000:00100000:0.0:1787135945.527806:0:6678:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8e987c0d7480 x1873947595404032/t0(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:371/0 lens 504/0 e 0 to 0 dl 1787135956 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787135945.527817:0:6678:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e987c0d7480 with x1873947595404032 ext(0->12) 00010000:00010000:0.0:1787135945.527827:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 8 pid: 6674 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.527844:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 8 pid: 6674 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787135945.527853:0:6678:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e987c0d7480 00000100:00100000:0.0:1787135945.527892:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1787135945.527901:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2359:x1873947595404032:12345-192.168.203.38@tcp:4:lfs.0 00000100:00100000:3.0:1787135945.577038:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135945.577201:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135945.577248:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595404160 00000100:00100000:0.0:1787135945.577251:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595404288 00000100:00100000:3.0:1787135945.577263:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595404160 00000100:00100000:0.0:1787135945.577268:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595404288 00000100:00100000:3.0:1787135945.577338:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 282 00000100:00100000:0.0:1787135945.577377:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:0.0:1787135945.577389:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2362:x1873947595404288:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135945.577607:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2362:x1873947595404288:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 218us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135945.577616:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:3.0:1787135945.578334:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98432e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:2362:x1873947595404160:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135945.578428:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98432e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:2362:x1873947595404160:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1078us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135945.578437:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 282 00000100:00080000:3.0:1787135945.578481:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1787135945.607597:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000100:00100000:2.0:1787135945.635231:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2359:x1873947595404032:12345-192.168.203.38@tcp:4:lfs.0 Request processed in 107320us (109757us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787135945.635250:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00002000:00100000:2.0:1787135945.635267:0:6678:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8e987c0d7480 x1873947595404032/t4294967299(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:371/0 lens 504/448 e 0 to 0 dl 1787135956 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787135945.635277:0:6678:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e987c0d7480 with x1873947595404032 ext(0->12) 00010000:00010000:2.0:1787135945.635288:0:6678:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 9 pid: 6674 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.635333:0:6678:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 9 pid: 6674 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787135945.635342:0:6678:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e987c0d7480 00000001:00080000:2.0:1787135945.635380:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1787135945.646493:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135945.646596:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595404416 00000100:00100000:1.0:1787135945.646605:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595404416 00010000:00010000:1.0:1787135945.646646:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 7 pid: 6674 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135945.646690:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:1.0:1787135945.646702:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595404416:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787135945.646718:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787135945.646736:0:7612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787135945.646739:0:7612:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787135945 00002000:00010000:1.0:1787135945.646742:0:7612:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787135945 00002000:00010000:1.0:1787135945.646744:0:7612:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787135945 00002000:00010000:1.0:1787135945.646747:0:7612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1787135945.646753:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 7 pid: 6674 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.647326:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 7 pid: 6674 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.647361:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002b811d2f/0xf5850c552f202706 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71823f expref: 7 pid: 6674 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.647451:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787135945.647457:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787135945.647466:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.647495:0:7612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.653453:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135945.653544:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595404416:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 6839us (7054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135945.653557:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00010000:00010000:2.0:1787135945.653829:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.653844:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.653881:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.653889:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.653897:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.653905:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aec00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787135945.653910:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.653918:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.653951:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.653959:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f20275a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135945.654012:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595403904:12345-192.168.203.38@tcp:1:lfs.0 Request processed in 132511us (132993us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135945.654020:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:3.0:1787135945.659350:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135945.663271:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595404672 00000100:00100000:1.0:1787135945.663286:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595404672 00000100:00100000:0.0:1787135945.663385:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:0.0:1787135945.663406:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:10297:x1873947595404672:12345-192.168.203.38@tcp:35:lfs.0 00000004:00010000:0.0:1787135945.663465:0:5824:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202745 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71825b expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787135945.664135:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787135945.664212:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787135945.665918:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787135945.665997:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.666016:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202753 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718262 expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.666024:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.666463:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718262 expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.666480:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202753 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718262 expref: 24 pid: 5823 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135945.666504:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533ab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5824:1873947616408320:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135945.666653:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c2540 going to sleep for 11 seconds 00000100:00100000:3.0:1787135945.671996:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135945.672332:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533ab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5824:1873947616408320:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787135945.672369:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135945.672531:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595404800 00000100:00100000:1.0:1787135945.672539:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595404800 00010000:00010000:1.0:1787135945.672575:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202753 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718262 expref: 25 pid: 5823 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135945.672613:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:1.0:1787135945.672622:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+25:2359:x1873947595404800:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787135945.672637:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135945.672644:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202753 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718262 expref: 25 pid: 5823 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.672656:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718262 expref: 25 pid: 5823 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.672678:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202753 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718262 expref: 25 pid: 5823 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.672693:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1200) 00010000:00010000:1.0:1787135945.672811:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.672838:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.672846:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135945.672873:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135945.672959:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:2359:x1873947595404800:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 336us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135945.672967:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00010000:00010000:0.0:1787135945.673336:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135945.673345:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787135945.673483:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1787135945.673673:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1787135945.673817:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533ab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1873947616408448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787135945.673876:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135945.673907:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c2840 going to sleep for 11 seconds 00000100:00100000:1.0:1787135945.674086:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616408448 00000100:00100000:1.0:1787135945.674101:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616408448 00000100:00100000:1.0:1787135945.674146:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787135945.674155:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1873947616408448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787135945.674222:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1873947616408448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 68us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135945.674228:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787135945.674267:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533ab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1873947616408448:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1787135945.674840:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787135945.675022:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:1.0:1787135945.675327:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0d4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1873947616408576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787135945.675364:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135945.675392:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874486000 going to sleep for 11 seconds 00000100:00100000:2.0:1787135945.675539:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616408576 00000100:00100000:2.0:1787135945.675546:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616408576 00000100:00100000:2.0:1787135945.675584:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787135945.675592:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5824:x1873947616408576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787135945.675804:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5824:x1873947616408576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 212us (439us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1787135945.675811:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787135945.675847:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0d4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1873947616408576:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787135945.675888:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787135945.675920:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.675930:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.675939:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.675952:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135945.675957:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.675965:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.675979:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1200) 00010000:00010000:2.0:1787135945.675982:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787135945.675987:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.675993:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202761 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787135945.676460:0:5824:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787135945.676648:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787135945.676659:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 305619610749ns, next at 306619608543ns, rc = 0 00000001:00080000:2.0:1787135945.676666:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787135945.676899:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1200) 00010000:00010000:2.0:1787135945.676904:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787135945.676911:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202745 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71825b expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135945.677000:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+27:10297:x1873947595404672:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 13605us (17659us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787135945.677007:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000020:00080000:2.0:1787135945.677011:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787135945.679720:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135945.679774:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595404928 00000100:00100000:2.0:1787135945.679784:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595404928 00000100:00100000:2.0:1787135945.679841:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:2.0:1787135945.679850:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+27:10297:x1873947595404928:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135945.679872:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135945.679891:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202768 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718269 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.679942:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202768 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718269 expref: 28 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.679956:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202768 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718269 expref: 28 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.679973:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135945.679976:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787135945.679979:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7a00, rc 0) 00000100:00100000:2.0:1787135945.680034:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+28:10297:x1873947595404928:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 185us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135945.680073:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:3.0:1787135945.685797:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135945.685851:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595405184 00000100:00100000:2.0:1787135945.685861:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595405184 00000100:00100000:2.0:1787135945.685962:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:2.0:1787135945.685972:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9860735050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+28:10297:x1873947595405184:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1787135945.686224:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9860735050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+29:10297:x1873947595405184:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 253us (434us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787135945.686232:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1787135945.762568:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135945.762655:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595405440 00000100:00100000:3.0:1787135945.762666:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595405440 00000100:00100000:3.0:1787135945.762727:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:3.0:1787135945.762738:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+29:10307:x1873947595405440:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135945.762777:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135945.762797:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20276f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718270 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135945.762911:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787135945.763027:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20276f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718270 expref: 31 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.763040:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:3.0:1787135945.763098:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787135945.763105:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f20276f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718270 expref: 31 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.763121:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db600, rc 0) 00000100:00100000:3.0:1787135945.763338:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+30:10307:x1873947595405440:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 602us (779us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787135945.763345:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:3.0:1787135945.767473:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135945.767573:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595405568 00000100:00100000:2.0:1787135945.767583:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595405568 00000100:00100000:2.0:1787135945.767648:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1787135945.767659:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+30:10307:x1873947595405568:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:2.0:1787135945.767734:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f20277d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.767759:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f20277d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768034:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f20277d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768242:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202784 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768253:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768261:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768356:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20278b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768365:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20278b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768372:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20278b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787135945.768423:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20278b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768447:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f20277d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768453:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f20277d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768460:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f20277d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768465:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135945.768469:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f20277d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768477:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f20277d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768490:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135945.768492:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135945.768497:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f20277d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768502:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f20277d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768515:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768521:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202784 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768525:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768536:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135945.768539:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768544:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202784 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768551:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98532d1d00) 00010000:00010000:2.0:1787135945.768554:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135945.768556:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202784 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768560:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202784 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768573:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20278b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768579:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20278b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768585:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20278b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768590:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135945.768592:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20278b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768597:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20278b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768612:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135945.768614:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135945.768617:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20278b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.768622:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20278b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135945.768699:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+30:10307:x1873947595405568:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 1041us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135945.768707:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:1.0:1787135945.771902:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135945.772012:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595405824 00000100:00100000:2.0:1787135945.772022:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595405824 00000100:00100000:2.0:1787135945.772327:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1787135945.772338:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+30:10307:x1873947595405824:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1787135945.772585:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+31:10307:x1873947595405824:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 248us (690us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1787135945.772592:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00010000:00010000:3.0:1787135945.816211:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135945.821938:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135945.822039:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595406080 00000100:00100000:3.0:1787135945.822072:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595406080 00000100:00100000:3.0:1787135945.822137:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:3.0:1787135945.822148:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+31:10310:x1873947595406080:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135945.822171:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135945.822191:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202792 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718277 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822262:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202799 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822277:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822288:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822301:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822323:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822330:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822463:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822473:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822480:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135945.822490:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787135945.822585:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202799 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822593:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202799 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822599:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822606:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511da200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135945.822610:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202799 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822618:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202799 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822641:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:3.0:1787135945.822644:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135945.822649:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202799 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822655:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202799 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822669:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822675:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822680:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822685:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135945.822688:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822695:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822702:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9843179800) 00010000:00010000:3.0:1787135945.822704:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135945.822707:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822712:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822783:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202792 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718277 expref: 34 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822799:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718277 expref: 33 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135945.822807:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135945.822809:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787135945.822811:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dac00, rc 0) 00000100:00100000:3.0:1787135945.822875:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+33:10310:x1873947595406080:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 729us (946us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1787135945.822883:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:0.0:1787135945.826838:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135945.826915:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595406208 00000100:00100000:2.0:1787135945.826925:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595406208 00000100:00100000:2.0:1787135945.826981:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:2.0:1787135945.826991:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+33:10310:x1873947595406208:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:2.0:1787135945.827079:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2027b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.827107:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2027b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.827135:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2027b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.827161:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2027b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.827168:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2027b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.827174:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2027b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.827180:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135945.827184:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2027b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.827192:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2027b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.827204:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135945.827207:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787135945.827211:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2027b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135945.827217:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2027b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135945.827290:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+33:10310:x1873947595406208:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 299us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135945.827298:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:1.0:1787135945.829994:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135945.830081:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595406464 00000100:00100000:0.0:1787135945.830100:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595406464 00000100:00100000:0.0:1787135945.830148:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:0.0:1787135945.830158:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+33:10310:x1873947595406464:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1787135945.830367:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:10310:x1873947595406464:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 210us (381us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787135945.830391:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:0.0:1787135946.110174:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135946.110271:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595406720 00000100:00100000:3.0:1787135946.110280:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595406720 00000100:00100000:3.0:1787135946.110489:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:3.0:1787135946.110498:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:10341:x1873947595406720:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:3.0:1787135946.110517:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135946.110533:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2027bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71827e expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.110617:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f2027c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.110629:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f2027c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.110638:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f2027c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135946.110661:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787135946.110820:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2027bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71827e expref: 37 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.110838:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f2027c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71827e expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.110847:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135946.110850:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787135946.110853:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db600, rc 0) 00000100:00100000:3.0:1787135946.110916:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+36:10341:x1873947595406720:12345-192.168.203.38@tcp:101:cat.0 Request processed in 419us (751us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787135946.110922:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:3.0:1787135946.115581:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135946.115638:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.116354:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595407104 00000100:00100000:0.0:1787135946.116365:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595407104 00000100:00100000:2.0:1787135946.116517:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595406848 00000100:00100000:2.0:1787135946.116534:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595406848 00000100:00100000:2.0:1787135946.116577:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1787135946.116586:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+37:2360:x1873947595406848:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135946.116600:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135946.116622:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f2027c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71827e expref: 37 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.116638:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135946.116642:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135946.116692:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457cac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+36:2360:x1873947595406848:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 107us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135946.116700:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1787135946.117258:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:0.0:1787135946.117269:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+35:10341:x1873947595407104:12345-192.168.203.38@tcp:35:cat.0 00000100:00100000:0.0:1787135946.117803:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+36:10341:x1873947595407104:12345-192.168.203.38@tcp:35:cat.0 Request processed in 535us (2163us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1787135946.117811:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:1.0:1787135946.197628:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135946.204615:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595407360 00000100:00100000:2.0:1787135946.204637:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595407360 00000100:00100000:2.0:1787135946.204711:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:2.0:1787135946.204722:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+36:10347:x1873947595407360:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1787135946.204749:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135946.204753:0:7623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787135946.204788:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71824d expref: 36 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.204808:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135946.204812:0:7623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135946.204825:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2027d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718285 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.204910:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.204937:0:7623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718277 expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.204946:0:7623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.204976:0:7623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718277 expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.204989:0:7623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718277 expref: 36 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135946.205002:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616408704:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135946.205195:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c4e0780 going to sleep for 11 seconds 00000100:00100000:2.0:1787135946.210197:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.210282:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595407488 00000100:00100000:0.0:1787135946.210299:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595407488 00010000:00010000:0.0:1787135946.210339:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027a7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718277 expref: 37 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135946.210379:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:0.0:1787135946.210400:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+37:2359:x1873947595407488:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135946.210416:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135946.210423:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027a7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718277 expref: 37 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.210438:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718277 expref: 37 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.210468:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:0.0:1787135946.210478:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.210499:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.210507:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.210524:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135946.210581:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+37:2359:x1873947595407488:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 193us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135946.210588:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00010000:00010000:3.0:1787135946.211191:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718277 expref: 36 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135946.211209:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f7480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616408704:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135946.212951:0:7623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.212969:0:7623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.212973:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135946.213006:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787135946.213187:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2027d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718285 expref: 37 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.213203:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718285 expref: 36 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.213210:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135946.213212:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787135946.213215:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6400, rc 0) 00000100:00100000:3.0:1787135946.213281:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+36:10347:x1873947595407360:12345-192.168.203.38@tcp:101:dd.0 Request processed in 8561us (15662us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787135946.213298:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:2.0:1787135946.215617:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.215705:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595407744 00000100:00100000:0.0:1787135946.215713:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595407744 00000100:00100000:0.0:1787135946.215852:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:0.0:1787135946.215864:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+36:10347:x1873947595407744:12345-192.168.203.38@tcp:36:dd.0 00010000:00010000:0.0:1787135946.216273:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2027e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.216288:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2027e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.216296:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2027e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787135946.216334:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1787135946.216351:0:5822:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000096e9ced7 reply state 000000000be25ee6 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2027e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135946.216356:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787135946.216444:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+39:10347:x1873947595407744:12345-192.168.203.38@tcp:36:dd.0 Request processed in 582us (834us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787135946.216468:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000020:00080000:0.0:1787135946.216474:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787135946.218380:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2027e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.218404:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2027e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.218411:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2027e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.218417:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135946.218422:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2027e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.218429:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2027e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.218459:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135946.218462:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135946.218467:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2027e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.218473:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2027e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135946.394809:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135946.394932:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595407872 00000100:00100000:3.0:1787135946.394942:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595407872 00000100:00100000:3.0:1787135946.395009:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:3.0:1787135946.395020:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+38:10361:x1873947595407872:12345-192.168.203.38@tcp:101:stat.0 00010000:00010000:3.0:1787135946.395042:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135946.395182:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71828c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.395251:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2027f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.395266:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2027f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.395277:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2027f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.395291:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.395298:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.395322:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.395489:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.395501:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718285 expref: 39 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.395510:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202802 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.395542:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718285 expref: 39 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.395556:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718285 expref: 39 pid: 7623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135946.395570:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fde300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1873947616408832:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135946.395700:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9851155d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787135946.398912:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135946.399000:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fde300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1873947616408832:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135946.399021:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135946.414646:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595408128 00000100:00100000:1.0:1787135946.414677:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595408128 00000100:00100000:1.0:1787135946.414763:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:1.0:1787135946.414774:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+40:5597:x1873947595408128:12345-192.168.203.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787135946.415132:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+41:5597:x1873947595408128:12345-192.168.203.38@tcp:35:ldlm_bl.0 Request processed in 352us (16220us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787135946.415141:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:1.0:1787135946.420138:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135946.420539:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595408256 00000100:00100000:2.0:1787135946.420613:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595408256 00010000:00010000:2.0:1787135946.420658:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718285 expref: 41 pid: 7623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135946.421041:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:2.0:1787135946.421081:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+41:2359:x1873947595408256:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135946.421107:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135946.421114:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718285 expref: 41 pid: 7623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.421138:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718285 expref: 41 pid: 7623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.421162:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2027d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718285 expref: 41 pid: 7623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.421177:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135946.421182:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202802 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.421190:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.421198:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202802 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.421230:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135946.421300:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+40:2359:x1873947595408256:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 221us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135946.421307:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00010000:00010000:3.0:1787135946.421360:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421369:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135946.421430:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787135946.421435:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787135946.421486:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421498:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202802 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421507:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2027f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421514:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2027f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421520:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2027f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421525:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511dbe00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135946.421529:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2027f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421537:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2027f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421557:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:3.0:1787135946.421560:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135946.421564:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2027f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421570:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f2027f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421592:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421598:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421603:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421608:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135946.421611:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421616:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421625:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9843179800) 00010000:00010000:3.0:1787135946.421628:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135946.421631:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421637:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2027fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421674:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f2027ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71828c expref: 40 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421704:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202802 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71828c expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.421729:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135946.421733:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787135946.421742:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da200, rc 0) 00000100:00100000:3.0:1787135946.423521:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+39:10361:x1873947595407872:12345-192.168.203.38@tcp:101:stat.0 Request processed in 28237us (28456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135946.423534:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:2.0:1787135946.490212:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135946.491493:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595408512 00000100:00100000:3.0:1787135946.491507:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595408512 00000100:00100000:3.0:1787135946.491904:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:3.0:1787135946.491916:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+39:10367:x1873947595408512:12345-192.168.203.38@tcp:36:truncate.0 00010000:00010000:3.0:1787135946.491977:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135946.492004:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202802 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71828c expref: 39 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.492024:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135946.492029:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787135946.492401:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202809 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.492418:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.492430:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787135946.492498:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787135946.492534:0:5821:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000baa5d819 reply state 00000000f7c60609 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135946.492569:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787135946.493334:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+41:10367:x1873947595408512:12345-192.168.203.38@tcp:36:truncate.0 Request processed in 1418us (3129us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787135946.493343:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000020:00080000:3.0:1787135946.493349:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787135946.497245:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202809 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.497263:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202809 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.497273:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202809 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.497279:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511dac00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135946.497284:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202809 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.497292:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202809 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.497308:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135946.497311:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135946.497316:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202809 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.497322:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202809 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135946.622412:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135946.622590:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595408640 00000100:00100000:3.0:1787135946.622611:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595408640 00000100:00100000:3.0:1787135946.622711:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:3.0:1787135946.622721:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+40:10381:x1873947595408640:12345-192.168.203.38@tcp:101:stat.0 00010000:00010000:3.0:1787135946.622754:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135946.622774:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202810 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718293 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.622833:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202817 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.622846:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202817 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.622858:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202817 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.622871:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20281e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.622878:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20281e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.622884:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20281e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.622967:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.622976:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.622983:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135946.623022:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787135946.623026:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787135946.623044:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623102:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623112:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202817 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623120:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202817 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623127:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202817 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623133:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511da200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135946.623137:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202817 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623145:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202817 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623157:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:3.0:1787135946.623160:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135946.623164:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202817 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623171:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202817 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623197:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20281e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623204:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20281e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623211:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20281e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623216:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135946.623219:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20281e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623226:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20281e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623234:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9843179800) 00010000:00010000:3.0:1787135946.623237:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135946.623239:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20281e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623246:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20281e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623282:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202810 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718293 expref: 42 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623295:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718293 expref: 41 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.623313:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135946.623315:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787135946.623318:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dbe00, rc 0) 00000100:00100000:3.0:1787135946.623382:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+41:10381:x1873947595408640:12345-192.168.203.38@tcp:101:stat.0 Request processed in 663us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135946.623397:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:1.0:1787135946.681524:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.681625:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595408896 00000100:00100000:0.0:1787135946.681635:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595408896 00000100:00100000:0.0:1787135946.681693:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1787135946.681702:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+41:10391:x1873947595408896:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1787135946.681722:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135946.681739:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20282c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71829a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135946.681842:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787135946.681950:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20282c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71829a expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.681965:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:0.0:1787135946.681968:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787135946.681973:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20282c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71829a expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.681987:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896e00, rc 0) 00000100:00100000:0.0:1787135946.682130:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+42:10391:x1873947595408896:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 344us (529us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1787135946.682139:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:1.0:1787135946.685482:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135946.686185:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595409152 00000100:00100000:2.0:1787135946.686195:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595409152 00000100:00100000:2.0:1787135946.686678:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:2.0:1787135946.686690:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+42:10391:x1873947595409152:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1787135946.687318:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+43:10391:x1873947595409152:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 628us (1842us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1787135946.687348:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:1.0:1787135946.712914:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787135946.712940:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987485dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616409344:0@lo:400:kworker.0 00000100:00100000:3.0:1787135946.712948:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987485fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616409088:0@lo:400:kworker.0 00000100:00100000:2.0:1787135946.713025:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987485d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616409472:0@lo:400:kworker.0 00000100:00100000:3.0:1787135946.713034:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135946.713035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135946.713091:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135946.713134:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987485c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616408960:0@lo:400:kworker.0 00000100:00100000:0.0:1787135946.713141:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616409344 00000100:00100000:0.0:1787135946.713150:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616409344 00000100:00100000:2.0:1787135946.713206:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987485c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616409216:0@lo:400:kworker.0 00000100:00100000:3.0:1787135946.713228:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987485ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616409600:0@lo:400:kworker.0 00000100:00100000:0.0:1787135946.713259:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787135946.713284:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1873947616409344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135946.713291:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135946.713336:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616408960 00000100:00100000:1.0:1787135946.713341:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616408960 00000100:00100000:0.0:1787135946.713346:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3300:x1873947616409344:12345-0@lo:400:kworker.0 Request processed in 64us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135946.713353:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787135946.713397:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1787135946.713410:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616408960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135946.713413:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987485dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616409344:0@lo:400:kworker.0 00000100:00100000:0.0:1787135946.713439:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616409088 00000100:00100000:0.0:1787135946.713445:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616409088 00000100:00100000:0.0:1787135946.713468:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616409472 00000100:00100000:0.0:1787135946.713470:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616409472 00000100:00100000:0.0:1787135946.713490:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787135946.713496:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616409088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135946.713523:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616409088:12345-0@lo:400:kworker.0 Request processed in 27us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135946.713528:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1787135946.713537:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1787135946.713541:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616409472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135946.713564:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616409472:12345-0@lo:400:kworker.0 Request processed in 22us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135946.713570:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1787135946.713586:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135946.713588:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3300:x1873947616408960:12345-0@lo:400:kworker.0 Request processed in 181us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135946.713598:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1787135946.713605:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987485d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616409472:0@lo:400:kworker.0 00000100:00100000:1.0:1787135946.713642:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987485c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616408960:0@lo:400:kworker.0 00000100:00100000:3.0:1787135946.715289:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135946.715354:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987485fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616409088:0@lo:400:kworker.0 00000100:00100000:2.0:1787135946.715443:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135946.715522:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616409216 00000100:00100000:0.0:1787135946.715528:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616409216 00000100:00080000:2.0:1787135946.715580:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135946.715584:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1787135946.715592:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616409216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135946.715635:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616409600 00000100:00100000:1.0:1787135946.715640:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616409600 00000100:00100000:0.0:1787135946.715645:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616409216:12345-0@lo:400:kworker.0 Request processed in 54us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135946.715660:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787135946.715669:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787135946.715675:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616409600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135946.715725:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616409600:12345-0@lo:400:kworker.0 Request processed in 50us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135946.715731:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1787135946.715782:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787135946.715803:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987485c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616409216:0@lo:400:kworker.0 00000100:00100000:0.0:1787135946.715848:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987485ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616409600:0@lo:400:kworker.0 00000100:00100000:2.0:1787135946.739979:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.741087:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595409408 00000100:00100000:0.0:1787135946.741097:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595409408 00000100:00100000:0.0:1787135946.741162:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:0.0:1787135946.741172:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+43:10397:x1873947595409408:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1787135946.741199:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135946.741219:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20283a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182a1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.741317:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.741331:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718293 expref: 44 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.741339:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.741371:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718293 expref: 44 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.741383:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718293 expref: 44 pid: 7623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135946.741405:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987485ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616409728:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135946.741485:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135946.744002:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.744249:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987485ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616409728:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787135946.744283:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135946.744726:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595409536 00000100:00100000:1.0:1787135946.744782:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595409536 00010000:00010000:1.0:1787135946.744817:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718293 expref: 45 pid: 7623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135946.744885:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1787135946.744895:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+45:2360:x1873947595409536:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787135946.744908:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135946.744915:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718293 expref: 45 pid: 7623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135946.744927:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718293 expref: 45 pid: 7623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135946.744948:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202825 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718293 expref: 45 pid: 7623 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135946.744962:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:1.0:1787135946.744967:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135946.744975:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135946.744982:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135946.745021:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787135946.745250:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.745259:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135946.745284:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787135946.745426:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20283a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182a1 expref: 46 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.745442:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182a1 expref: 45 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.745450:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135946.745458:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787135946.745461:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897800, rc 0) 00000100:00100000:1.0:1787135946.745500:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+45:2360:x1873947595409536:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 607us (1504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135946.745509:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1787135946.745549:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+44:10397:x1873947595409408:12345-192.168.203.38@tcp:101:bash.0 Request processed in 4379us (5580us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787135946.745556:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:1.0:1787135946.750075:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.750253:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595409792 00000100:00100000:0.0:1787135946.750262:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595409792 00000100:00100000:0.0:1787135946.750348:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:0.0:1787135946.750359:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+44:10397:x1873947595409792:12345-192.168.203.38@tcp:36:bash.0 00010000:00010000:0.0:1787135946.750594:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f20284f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.750611:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f20284f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.750622:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f20284f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787135946.750663:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1787135946.750684:0:5823:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000009e79bb9a reply state 0000000007a9c964 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f20284f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135946.750693:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787135946.750782:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+47:10397:x1873947595409792:12345-192.168.203.38@tcp:36:bash.0 Request processed in 425us (738us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1787135946.750790:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000020:00080000:0.0:1787135946.750796:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787135946.755623:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f20284f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.755641:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f20284f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.755707:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f20284f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.755716:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135946.755720:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f20284f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.755728:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f20284f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.755743:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135946.755746:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135946.755751:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f20284f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.755757:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f20284f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135946.758694:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135946.758812:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595409920 00000100:00100000:3.0:1787135946.758822:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595409920 00000100:00100000:3.0:1787135946.758936:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1787135946.758969:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+46:10397:x1873947595409920:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1787135946.758993:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135946.759011:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202856 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182a8 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.759145:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20285d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.759160:0:7623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182a1 expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.759169:0:7623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20285d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.759199:0:7623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182a1 expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.759211:0:7623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182a1 expref: 47 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135946.759224:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616409856:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135946.759298:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9851155180 going to sleep for 11 seconds 00000100:00100000:3.0:1787135946.763720:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fdf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616409856:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135946.763755:0:7623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20285d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135946.764486:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.764908:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595410048 00000100:00100000:0.0:1787135946.764916:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595410048 00010000:00010000:0.0:1787135946.764952:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182a1 expref: 48 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135946.765010:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:0.0:1787135946.765020:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+48:2359:x1873947595410048:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135946.765034:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135946.765041:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182a1 expref: 48 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.765098:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182a1 expref: 48 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.765120:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202841 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182a1 expref: 48 pid: 5821 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.765134:0:7612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:0.0:1787135946.765139:0:7612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20285d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.765149:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20285d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.765157:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20285d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.765178:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135946.765223:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+47:2359:x1873947595410048:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 204us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135946.765230:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00010000:00010000:3.0:1787135946.765719:0:7623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20285d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.765853:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20285d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135946.765895:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787135946.765899:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787135946.765918:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20285d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.765948:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202856 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182a8 expref: 47 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.765963:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20285d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182a8 expref: 46 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135946.765970:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135946.765973:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787135946.765975:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db400, rc 0) 00000100:00100000:3.0:1787135946.766005:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+46:10397:x1873947595409920:12345-192.168.203.38@tcp:101:bash.0 Request processed in 7040us (7320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135946.766012:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1787135946.768375:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.768449:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595410304 00000100:00100000:0.0:1787135946.768466:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595410304 00000100:00100000:0.0:1787135946.768514:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:0.0:1787135946.768523:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9860735450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+46:10397:x1873947595410304:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:0.0:1787135946.768740:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9860735450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+47:10397:x1873947595410304:12345-192.168.203.38@tcp:35:bash.0 Request processed in 217us (373us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787135946.768748:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:1.0:1787135946.815630:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135946.815676:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595410560 00000100:00100000:3.0:1787135946.815685:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595410560 00000100:00100000:3.0:1787135946.815891:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:3.0:1787135946.815902:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+47:10407:x1873947595410560:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135946.815925:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135946.815944:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202864 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182af expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135946.816411:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787135946.816544:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202864 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182af expref: 49 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.816559:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:2.0:1787135946.816562:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787135946.816567:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202864 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182af expref: 49 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.816580:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da200, rc 0) 00000100:00100000:2.0:1787135946.816637:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+48:10407:x1873947595410560:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 736us (1013us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1787135946.816646:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:3.0:1787135946.819306:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.819407:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595410688 00000100:00100000:0.0:1787135946.819416:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595410688 00000100:00100000:0.0:1787135946.819500:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:0.0:1787135946.819510:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+48:10407:x1873947595410688:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:0.0:1787135946.819573:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202872 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819589:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819600:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819615:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819622:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819629:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819706:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202880 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819729:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819747:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787135946.819793:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819804:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202872 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819810:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202872 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819816:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819822:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135946.819826:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202872 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819832:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202872 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819843:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:0.0:1787135946.819846:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135946.819849:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202872 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819855:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202872 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819872:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819878:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202879 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819883:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819888:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135946.819891:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819897:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819905:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98494a1b00) 00010000:00010000:0.0:1787135946.819907:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135946.819910:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202879 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819916:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819929:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202880 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819935:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202880 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819940:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819950:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135946.819953:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202880 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819959:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202880 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819966:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:0.0:1787135946.819969:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135946.819971:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202880 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.819977:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202880 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135946.820070:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+48:10407:x1873947595410688:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 539us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135946.820078:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:1.0:1787135946.824103:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135946.824183:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595410944 00000100:00100000:2.0:1787135946.824204:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595410944 00000100:00100000:2.0:1787135946.824256:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:2.0:1787135946.824268:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+48:10407:x1873947595410944:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1787135946.824553:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+49:10407:x1873947595410944:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 287us (456us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787135946.824565:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00010000:00010000:1.0:1787135946.840233:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135946.855455:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.855522:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595411200 00000100:00100000:0.0:1787135946.855532:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595411200 00000100:00100000:0.0:1787135946.855596:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:0.0:1787135946.855606:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+49:10410:x1873947595411200:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1787135946.855630:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135946.855652:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202887 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182b6 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.855720:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f20288e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.855750:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f20288e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.855760:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f20288e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.855791:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.855798:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.855804:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.855923:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20289c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.855932:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20289c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.855945:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20289c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135946.855954:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787135946.856091:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f20288e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856100:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f20288e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856106:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f20288e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856128:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135946.856132:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f20288e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856140:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f20288e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856152:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:0.0:1787135946.856154:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135946.856159:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f20288e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856165:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f20288e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856177:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856183:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202895 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856189:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856194:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135946.856197:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856211:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202895 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856230:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98494a1b00) 00010000:00010000:0.0:1787135946.856232:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135946.856235:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202895 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856241:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.856281:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202887 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182b6 expref: 52 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.857040:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20289c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182b6 expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.857142:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:0.0:1787135946.857145:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787135946.857149:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897200, rc 0) 00000100:00100000:0.0:1787135946.857220:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+51:10410:x1873947595411200:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1616us (1774us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787135946.857228:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:3.0:1787135946.860401:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135946.860443:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.860588:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595411328 00000100:00100000:0.0:1787135946.860598:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595411328 00000100:00100000:0.0:1787135946.860654:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1787135946.860663:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+51:2360:x1873947595411328:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135946.860677:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135946.860698:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20289c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182b6 expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.860732:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00000100:00100000:2.0:1787135946.860753:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595411456 00000100:00100000:2.0:1787135946.860759:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595411456 00000100:00100000:2.0:1787135946.860806:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:2.0:1787135946.860815:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+51:10410:x1873947595411456:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:2.0:1787135946.860865:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.860869:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135946.860882:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.860893:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.860915:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135946.860927:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+51:2360:x1873947595411328:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 263us (544us total) trans 0 rc 0/0 00010000:00010000:2.0:1787135946.860932:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135946.860939:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00010000:00010000:2.0:1787135946.860945:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.860951:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135946.860956:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.860970:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.860979:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135946.860982:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787135946.860985:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.860991:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135946.861023:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+50:10410:x1873947595411456:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 211us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135946.861030:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:1.0:1787135946.863358:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.863485:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595411712 00000100:00100000:0.0:1787135946.863494:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595411712 00000100:00100000:0.0:1787135946.863548:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:0.0:1787135946.863558:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+50:10410:x1873947595411712:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1787135946.863867:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+51:10410:x1873947595411712:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 309us (516us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787135946.863876:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:1.0:1787135946.942353:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135946.942436:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595411968 00000100:00100000:2.0:1787135946.942447:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595411968 00000100:00100000:2.0:1787135946.942562:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:2.0:1787135946.942574:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+51:10428:x1873947595411968:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:2.0:1787135946.942598:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135946.942618:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182bd expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.942707:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.942727:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.942738:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135946.942769:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787135946.942890:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182bd expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.942910:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182bd expref: 53 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.942919:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135946.942921:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787135946.942925:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7c00, rc 0) 00000100:00100000:2.0:1787135946.942978:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10428:x1873947595411968:12345-192.168.203.38@tcp:101:cat.0 Request processed in 407us (635us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787135946.942985:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:3.0:1787135946.965679:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.965736:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595412096 00000100:00100000:0.0:1787135946.965745:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595412096 00000100:00100000:0.0:1787135946.965792:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:0.0:1787135946.965802:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10429:x1873947595412096:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1787135946.965826:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135946.965845:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2028c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182c4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.965913:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2028cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.965927:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2028cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.965966:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2028cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135946.966021:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787135946.966025:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787135946.966092:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2028cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.966117:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2028c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182c4 expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.966135:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2028cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182c4 expref: 54 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.966144:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:0.0:1787135946.966147:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787135946.966150:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896600, rc 0) 00000100:00100000:0.0:1787135946.966212:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10429:x1873947595412096:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 411us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135946.966219:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:1.0:1787135946.970278:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135946.970334:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595412480 00000100:00100000:2.0:1787135946.970344:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595412480 00000100:00100000:2.0:1787135946.970414:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:2.0:1787135946.970424:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10429:x1873947595412480:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1787135946.970712:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10429:x1873947595412480:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 289us (441us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787135946.970719:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:1.0:1787135946.972935:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.972988:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595412608 00000100:00100000:0.0:1787135946.972996:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595412608 00000100:00100000:0.0:1787135946.973066:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:0.0:1787135946.973075:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10429:x1873947595412608:12345-192.168.203.38@tcp:103:lfs.0 00010000:00010000:0.0:1787135946.973088:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787135946.973111:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f20285d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182a8 expref: 55 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.973145:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182bd expref: 54 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.973155:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202768 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718269 expref: 53 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.973163:0:7612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:0.0:1787135946.973172:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135946.973212:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:10429:x1873947595412608:12345-192.168.203.38@tcp:103:lfs.0 Request processed in 139us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135946.973220:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1787135946.977083:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135946.977229:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595412736 00000100:00100000:0.0:1787135946.977238:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595412736 00000100:00100000:0.0:1787135946.977413:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:0.0:1787135946.977424:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:10429:x1873947595412736:12345-192.168.203.38@tcp:58:lfs.0 00010000:00010000:0.0:1787135946.977538:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2028d4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.977552:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2028d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135946.977562:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2028d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787135946.978023:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787135946.978284:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787135946.978345:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787135946.978460:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:10429:x1873947595412736:12345-192.168.203.38@tcp:58:lfs.0 Request processed in 1036us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135946.978469:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:1.0:1787135946.991924:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135946.991996:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595412864 00000100:00100000:2.0:1787135946.992007:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595412864 00000100:00100000:2.0:1787135946.992136:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:2.0:1787135946.992147:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:10431:x1873947595412864:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135946.992168:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135946.992201:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182cb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992265:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2028e2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992291:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2028e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992311:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2028e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992330:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2028e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992339:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2028e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992346:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2028e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992465:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992474:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992482:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135946.992517:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787135946.992521:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135946.992546:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992570:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992578:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2028e2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992585:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2028e2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992591:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2028e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992597:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135946.992601:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2028e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992608:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2028e2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992619:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135946.992622:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135946.992625:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2028e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992631:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f2028e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992641:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2028e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992646:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2028e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992672:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2028e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992677:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135946.992680:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2028e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992687:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2028e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992695:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98532d1000) 00010000:00010000:2.0:1787135946.992697:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135946.992700:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2028e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992705:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2028e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992743:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2028db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182cb expref: 54 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992756:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182cb expref: 53 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135946.992763:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:2.0:1787135946.992765:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787135946.992768:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7c00, rc 0) 00000100:00100000:2.0:1787135946.992821:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10431:x1873947595412864:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 677us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135946.992838:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00000004:00080000:3.0:1787135947.224361:0:6719:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307167311015ns, next at 308167308813ns, rc = 0 00000100:00100000:2.0:1787135947.224517:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787135947.224536:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787135947.224551:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616410112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135947.224552:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98606d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616409984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787135947.224620:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135947.224659:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135947.224688:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616410112 00000100:00100000:3.0:1787135947.224696:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616410112 00000100:00100000:3.0:1787135947.224745:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616409984 00000100:00100000:3.0:1787135947.224749:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616409984 00000100:00100000:0.0:1787135947.224841:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787135947.224852:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616410112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787135947.224885:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135947.224943:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616410112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135947.224950:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787135947.225025:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787135947.225032:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1873947616409984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787135947.225072:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787135947.225114:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787135947.225118:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1873947616409984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135947.225125:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787135947.225170:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98606d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616409984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135947.225270:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616410112:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787135947.416422:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787135947.416432:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787135947.416485:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787135947.416492:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787135947.417625:0:11666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842bf1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1873947616410240:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787135947.417803:0:11666:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98744863c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135947.420158:0:11666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842bf1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1873947616410240:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787135947.422438:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.422579:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595412992 00000100:00100000:2.0:1787135947.422588:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595412992 00000100:00100000:2.0:1787135947.422696:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:2.0:1787135947.422708:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10442:x1873947595412992:12345-192.168.203.38@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787135947.422787:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10442:x1873947595412992:12345-192.168.203.38@tcp:900:lhsmtool_posix.0 Request processed in 81us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135947.422795:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00080000:0.0:1787135947.422848:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135947.429982:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.430156:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595413120 00000100:00100000:2.0:1787135947.430167:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595413120 00000100:00100000:2.0:1787135947.430509:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:2.0:1787135947.430521:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10442:x1873947595413120:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787135947.430550:0:5822:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787135947.430654:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10442:x1873947595413120:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 136us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135947.430662:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:1.0:1787135947.435359:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.435462:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595413248 00000100:00100000:0.0:1787135947.435471:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595413248 00000100:00100000:0.0:1787135947.435528:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:0.0:1787135947.435538:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10442:x1873947595413248:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787135947.435599:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2028f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435615:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2028f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435629:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2028f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435643:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2028fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435667:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2028fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435675:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2028fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435700:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435709:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435715:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135947.435750:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1787135947.435754:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787135947.435778:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435791:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2028f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435798:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2028f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435805:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2028f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435810:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135947.435815:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2028f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435828:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2028f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435840:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9853809600) 00010000:00010000:0.0:1787135947.435843:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135947.435848:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2028f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435855:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2028f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435868:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2028fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435875:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2028fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435881:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2028fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435886:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135947.435889:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2028fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435894:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2028fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435901:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8e98494a1a00) 00010000:00010000:0.0:1787135947.435903:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135947.435905:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2028fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435922:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f2028fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435937:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435942:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202905 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435948:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435952:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135947.435955:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435961:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435969:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:0.0:1787135947.435971:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135947.435974:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202905 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.435979:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135947.436348:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10442:x1873947595413248:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 Request processed in 809us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135947.436356:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:1.0:1787135947.438043:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.438412:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595413504 00000100:00100000:0.0:1787135947.438420:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595413504 00000100:00100000:0.0:1787135947.438501:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:0.0:1787135947.438510:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10442:x1873947595413504:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787135947.438527:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135947.438541:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f20290c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182d2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.438631:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202913 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.438643:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.438653:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135947.438664:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787135947.438757:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.438765:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202913 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.438771:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.438777:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135947.438781:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.438788:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202913 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.438804:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:0.0:1787135947.438807:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787135947.438812:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202913 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.438819:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202913 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.438851:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f20290c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182d2 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.438861:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9853809600) 00010000:00010000:0.0:1787135947.438863:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787135947.438866:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f20290c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182d2 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.438876:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897a00, rc 0) 00000100:00100000:0.0:1787135947.438923:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10442:x1873947595413504:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 414us (883us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1787135947.438930:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:2.0:1787135947.440775:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.440848:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595413632 00000100:00100000:0.0:1787135947.440856:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595413632 00000100:00100000:0.0:1787135947.440899:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:0.0:1787135947.440909:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10442:x1873947595413632:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787135947.440936:0:5821:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787135947.441073:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10442:x1873947595413632:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 143us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135947.441103:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:1.0:1787135947.443475:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.443916:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595413888 00000100:00100000:2.0:1787135947.443925:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595413888 00000100:00100000:2.0:1787135947.443988:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:2.0:1787135947.443998:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10442:x1873947595413888:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787135947.444016:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135947.444020:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787135947.444077:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2028cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182c4 expref: 54 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.444094:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135947.444100:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135947.444242:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202921 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182d9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787135947.444702:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787135947.444970:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202928 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.444983:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.444993:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.445165:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202921 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182d9 expref: 56 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.445183:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182d9 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.445192:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e98532d1000) 00010000:00010000:2.0:1787135947.445200:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787135947.445204:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6800, rc 0) 00000100:00100000:2.0:1787135947.445265:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10442:x1873947595413888:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 1268us (1799us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787135947.445274:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:1.0:1787135947.447692:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.447748:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595414144 00000100:00100000:2.0:1787135947.447757:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595414144 00000100:00100000:2.0:1787135947.447829:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:2.0:1787135947.447839:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10442:x1873947595414144:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787135947.447895:0:7623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135947.447925:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202928 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182d9 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.447951:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e98532d1000) 00010000:00010000:2.0:1787135947.447961:0:7623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135947.447980:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202936 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.447993:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202936 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448002:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202936 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448015:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20293d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x6a2e1ec7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448022:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20293d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a2e1ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448042:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20293d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a2e1ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448133:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202936 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448141:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202936 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448148:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202936 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448154:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135947.448158:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202936 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448165:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202936 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448174:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135947.448177:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135947.448180:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202936 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448186:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202936 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448195:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20293d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a2e1ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448201:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20293d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a2e1ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448213:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20293d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a2e1ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448219:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135947.448222:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20293d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a2e1ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448228:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20293d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x6a2e1ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448236:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x6a2e1ec7 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135947.448239:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135947.448242:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20293d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6a2e1ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.448248:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20293d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x6a2e1ec7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135947.448580:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10442:x1873947595414144:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 742us (892us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787135947.448588:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:3.0:1787135947.451588:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.451782:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595414272 00000100:00100000:0.0:1787135947.451791:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595414272 00000100:00100000:0.0:1787135947.451879:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:0.0:1787135947.451893:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10442:x1873947595414272:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787135947.451911:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135947.451929:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202944 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182e0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.452017:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f20294b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.452030:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f20294b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.452166:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f20294b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.452258:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202944 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e0 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.452274:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f20294b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e0 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.452283:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:0.0:1787135947.452285:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787135947.452288:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897600, rc 0) 00000100:00100000:0.0:1787135947.452452:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10442:x1873947595414272:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 560us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135947.452466:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:1.0:1787135947.456018:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.456130:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595414528 00000100:00100000:2.0:1787135947.456141:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595414528 00000100:00100000:2.0:1787135947.456197:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:2.0:1787135947.456208:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10442:x1873947595414528:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787135947.456280:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202952 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.456296:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.456320:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787135947.456635:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1787135947.456647:0:7623:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307399598213ns, next at 308399595044ns, rc = 0 00000004:00010000:2.0:1787135947.456753:0:7623:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000d40b0089 reply state 0000000074aa0a75 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135947.456762:0:7623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787135947.456865:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:10442:x1873947595414528:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 658us (854us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787135947.456873:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 76 00010000:00010000:3.0:1787135947.458999:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135947.459004:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1787135947.459010:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202952 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.459018:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.459024:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135947.459038:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.459060:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202952 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.459077:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:3.0:1787135947.459080:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787135947.459089:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202952 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.459096:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202952 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135947.459277:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595414656 00000100:00100000:2.0:1787135947.459285:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595414656 00000100:00100000:2.0:1787135947.459316:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:2.0:1787135947.459322:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:10442:x1873947595414656:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787135947.459338:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135947.459353:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202959 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182e7 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.459411:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e7 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.459424:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e7 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.459441:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:2.0:1787135947.459449:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787135947.459453:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7a00, rc 0) 00000100:00100000:2.0:1787135947.459512:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:10442:x1873947595414656:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 189us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135947.459520:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:3.0:1787135947.463452:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.463950:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595414784 00000100:00100000:0.0:1787135947.463961:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595414784 00000100:00100000:0.0:1787135947.464014:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:0.0:1787135947.464023:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1873947595414784:12345-192.168.203.38@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1787135947.464090:0:6673:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:0.0:1787135947.464121:0:6673:0:(genops.c:1406:class_connect()) connect: client a1006dc5-9c90-4762-af1c-1ab0be9a05b8, cookie 0xf5850c552f202960 00002000:00100000:0.0:1787135947.464134:0:6673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a1006dc5-9c90-4762-af1c-1ab0be9a05b8/ffff8e9851517800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113908 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787135947.464144:0:6673:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787135947.464374:0:6673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787135947.464414:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8e984564a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787135947.464526:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2358:x1873947595414784:12345-192.168.203.38@tcp:8:lhsmtool_posix.0 Request processed in 502us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135947.464534:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1787135947.465884:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135947.465983:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595414912 00000100:00100000:1.0:1787135947.465990:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595414912 00000100:00100000:1.0:1787135947.466156:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:1.0:1787135947.466166:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:0:x1873947595414912:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787135947.466735:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787135947.497509:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:0:x1873947595414912:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 31334us (31616us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787135947.497522:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000001:00100000:0.0:1787135947.498003:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000001:00080000:0.0:1787135947.498017:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:1.0:1787135947.501029:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.501343:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595415168 00000100:00100000:2.0:1787135947.501353:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595415168 00000100:00100000:2.0:1787135947.501457:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:2.0:1787135947.501468:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:10442:x1873947595415168:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787135947.501683:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:10442:x1873947595415168:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 217us (662us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787135947.501691:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:3.0:1787135947.503701:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.503788:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595415424 00000100:00100000:0.0:1787135947.503797:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595415424 00000100:00100000:0.0:1787135947.503855:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:0.0:1787135947.503864:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:10442:x1873947595415424:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787135947.503963:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:10442:x1873947595415424:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 100us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135947.503971:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:3.0:1787135947.505609:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.505689:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595415552 00000100:00100000:2.0:1787135947.505696:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595415552 00000100:00100000:2.0:1787135947.505744:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:2.0:1787135947.505753:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:10442:x1873947595415552:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787135947.505768:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135947.505786:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202967 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182ee expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.505845:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20296e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.505859:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20296e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.505870:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20296e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135947.505917:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135947.505934:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20296e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.505957:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202967 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182ee expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.505973:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20296e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182ee expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.505982:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:2.0:1787135947.505985:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787135947.505988:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7000, rc 0) 00000100:00100000:2.0:1787135947.506034:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:10442:x1873947595415552:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 283us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135947.506041:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:1.0:1787135947.510009:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.510160:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595415680 00000100:00100000:0.0:1787135947.510170:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595415680 00000100:00100000:0.0:1787135947.510237:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:0.0:1787135947.510247:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595415680:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787135947.510264:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135947.510283:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067b56437/0xf5850c552f202975 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182f5 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787135947.510309:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8587cb, blocks: 0x1 00010000:00010000:0.0:1787135947.510409:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1787135947.510414:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135947.510424:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067b56437/0xf5850c552f202975 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182f5 expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.510444:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000067b56437/0xf5850c552f202975 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182f5 expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.510456:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897a00, rc 0) 00000100:00100000:0.0:1787135947.510516:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595415680:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 271us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135947.510524:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:3.0:1787135947.513509:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.515869:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595415936 00000100:00100000:0.0:1787135947.515882:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595415936 00000100:00100000:0.0:1787135947.515943:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:0.0:1787135947.515954:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:10442:x1873947595415936:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787135947.516069:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:10442:x1873947595415936:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 117us (2571us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135947.516084:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:3.0:1787135947.520148:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135947.520239:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595416064 00000100:00100000:1.0:1787135947.520248:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595416064 00000100:00100000:1.0:1787135947.520305:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:1.0:1787135947.520315:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:10442:x1873947595416064:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787135947.520331:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135947.520352:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7182fc expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.520391:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000067b56437/0xf5850c552f202975 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182f5 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.520402:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787135947.520407:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787135947.520421:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182fc expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.520455:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000067b56437/0xf5850c552f202975 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182f5 expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.520469:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000067b56437/0xf5850c552f202975 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182f5 expref: 7 pid: 6673 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135947.520484:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98769c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6672:1873947616410368:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787135947.520565:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98604570c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135947.525467:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.525565:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98769c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6672:1873947616410368:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135947.525598:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182fc expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.525617:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533ae000, rc 0) 00000100:00100000:2.0:1787135947.525667:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:10442:x1873947595416064:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 5354us (5528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135947.525675:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:0.0:1787135947.525804:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595416192 00000100:00100000:0.0:1787135947.525811:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595416192 00010000:00010000:0.0:1787135947.525838:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000067b56437/0xf5850c552f202975 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182f5 expref: 7 pid: 6673 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135947.525869:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:0.0:1787135947.525877:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457cb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2359:x1873947595416192:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135947.525890:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135947.525910:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000067b56437/0xf5850c552f202975 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182f5 expref: 7 pid: 6673 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.525922:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000067b56437/0xf5850c552f202975 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182f5 expref: 7 pid: 6673 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.525942:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067b56437/0xf5850c552f202975 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182f5 expref: 7 pid: 6673 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.525953:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135947.525957:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135947.525964:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182fc expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.525973:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182fc expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.526021:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182fc expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135947.526035:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987485ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873947616410496:192.168.203.38@tcp:105: 00000100:00100000:0.0:1787135947.526138:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c2480 going to sleep for 11 seconds 00000100:00100000:2.0:1787135947.533896:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.533997:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987485ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873947616410496:192.168.203.38@tcp:105: 00010000:00010000:0.0:1787135947.534021:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135947.534099:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457cb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595416192:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 8221us (8640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135947.534110:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:3.0:1787135947.534611:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595416320 00000100:00100000:3.0:1787135947.534619:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595416320 00002000:00100000:3.0:1787135947.534660:0:6680:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e987c4c0000 x1873947595416320/t0(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:373/0 lens 504/0 e 0 to 0 dl 1787135958 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787135947.534670:0:6680:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e987c4c0000 with x1873947595416320 ext(0->8) 00002000:00010000:3.0:1787135947.534675:0:6680:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e987c4c0000 00000100:00100000:3.0:1787135947.534705:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:3.0:1787135947.534713:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595416320:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787135947.536413:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595416320:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 Request processed in 1695us (2519us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787135947.536430:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00002000:00100000:2.0:1787135947.536440:0:6680:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e987c4c0000 x1873947595416320/t4294967302(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:373/0 lens 504/448 e 0 to 0 dl 1787135958 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787135947.536451:0:6680:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e987c4c0000 with x1873947595416320 ext(0->8) 00002000:00010000:2.0:1787135947.536456:0:6680:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e987c4c0000 00000100:00100000:2.0:1787135947.541002:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135947.541096:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595416448 00000100:00100000:1.0:1787135947.541105:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595416448 00000100:00100000:1.0:1787135947.541192:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:1.0:1787135947.541202:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:10442:x1873947595416448:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787135947.571554:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:10442:x1873947595416448:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 Request processed in 30346us (30553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135947.571567:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000001:00080000:1.0:1787135947.571590:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000020:00080000:1.0:1787135947.571635:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e9874486c00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787135947.571640:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e986078c600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e9874486f00 00000020:00080000:1.0:1787135947.571644:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e986078cc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e9876a39000 00000001:00080000:1.0:1787135947.571671:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1787135947.571677:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000004:00080000:1.0:1787135947.571870:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:1.0:1787135947.571886:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000100:00100000:1.0:1787135947.572014:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98769c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616410624:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787135947.572096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135947.572244:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616410624 00000100:00100000:0.0:1787135947.572261:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616410624 00000100:00100000:0.0:1787135947.572345:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787135947.572355:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616410624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787135947.572380:0:6673:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787135947.572428:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8587c9, atime: 0x6a8587c9, ctime: 0x6a8587c9, blocks: 0xb 00010000:00010000:0.0:1787135947.572437:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067b56437/0xf5850c552f202983 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.572452:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1787135947.572457:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135947.572473:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067b56437/0xf5850c552f202983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.572489:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067b56437/0xf5850c552f202983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.572506:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000067b56437/0xf5850c552f202983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.572514:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000067b56437/0xf5850c552f202983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.572531:0:6673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787135947.573026:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3301:x1873947616410624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 672us (928us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787135947.573035:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:1.0:1787135947.573064:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e98769c0a80/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787135947.573071:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98769c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616410624:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787135947.573082:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787135947.573099:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000067b56437/0xf5850c552f202983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.573108:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897a00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787135947.573113:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000067b56437/0xf5850c552f202983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.573123:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000067b56437/0xf5850c552f202983 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.573138:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000067b56437/0xf5850c552f202983 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.573145:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067b56437/0xf5850c552f202983 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.573167:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135947.573170:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135947.573172:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787135947.573180:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1787135947.573258:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787135947.573959:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787135947.574006:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987459b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616410752:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787135947.574037:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135947.574204:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616410752 00000100:00100000:1.0:1787135947.574214:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616410752 00000100:00100000:1.0:1787135947.574256:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787135947.574265:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616410752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787135947.574512:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787135947.574516:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787135947 00002000:00010000:1.0:1787135947.574518:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787135947.574520:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787135947 -> 1787135947 00002000:00010000:1.0:1787135947.574523:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787135947.574677:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1873947616410752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 404us (628us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787135947.574685:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:3.0:1787135947.575038:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e987459b800/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787135947.575073:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987459b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616410752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787135947.575200:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.575281:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595416576 00000100:00100000:0.0:1787135947.575286:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595416576 00000100:00100000:0.0:1787135947.575716:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:0.0:1787135947.575726:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2359:x1873947595416576:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787135947.598031:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1787135947.598067:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1787135947.598473:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595416576:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 Request processed in 22744us (23270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135947.598485:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:0.0:1787135947.600658:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.600838:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595416832 00000100:00100000:2.0:1787135947.600848:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595416832 00000100:00100000:2.0:1787135947.600900:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:2.0:1787135947.600910:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:10442:x1873947595416832:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787135947.600957:0:7623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135947.600980:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20296e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182ee expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.600999:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:2.0:1787135947.601004:0:7623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135947.601031:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20298a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.601100:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20298a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.601110:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20298a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787135947.601317:0:7623:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000008177c4da reply state 00000000052d538d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20298a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135947.601326:0:7623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787135947.601410:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:10442:x1873947595416832:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 502us (757us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787135947.601418:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:2.0:1787135947.603012:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1787135947.603087:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20298a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.603098:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20298a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.603105:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20298a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.603112:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135947.603116:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20298a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.603123:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20298a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.603136:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:3.0:1787135947.603138:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135947.603142:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20298a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.603147:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f20298a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135947.603266:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595416960 00000100:00100000:1.0:1787135947.603274:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595416960 00000100:00100000:1.0:1787135947.603317:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:1.0:1787135947.603326:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595416960:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787135947.603526:0:6672:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787135947.603530:0:6672:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787135947 -> 1787135946 00002000:00010000:1.0:1787135947.603532:0:6672:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787135945 00002000:00010000:1.0:1787135947.603535:0:6672:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787135947 -> 1787135946 00002000:00010000:1.0:1787135947.603537:0:6672:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787135947.603580:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595416960:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 255us (572us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787135947.603588:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:1.0:1787135947.606000:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.606207:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595417216 00000100:00100000:2.0:1787135947.606215:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595417216 00000100:00100000:2.0:1787135947.606262:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:2.0:1787135947.606270:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:10442:x1873947595417216:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787135947.606323:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.606340:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f20294b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e0 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.606348:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.606377:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f20294b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e0 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.606417:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f20294b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e0 expref: 13 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135947.606432:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874208380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616410880:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135947.606795:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c4e0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135947.608660:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.609177:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874208380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616410880:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135947.609200:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135947.609442:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595417344 00000100:00100000:1.0:1787135947.609448:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595417344 00010000:00010000:1.0:1787135947.609482:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f20294b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e0 expref: 14 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135947.609625:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:1.0:1787135947.609635:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:2359:x1873947595417344:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787135947.609648:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135947.609669:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f20294b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e0 expref: 14 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.609681:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f20294b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e0 expref: 14 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.609700:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f20294b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e0 expref: 14 pid: 5823 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.609714:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:1.0:1787135947.609719:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.610094:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.610101:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.610124:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135947.610152:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.610163:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.610190:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135947.610195:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2359:x1873947595417344:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 560us (1538us total) trans 0 rc 0/0 00010000:00010000:2.0:1787135947.610199:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135947.610208:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00010000:00010000:2.0:1787135947.610211:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.610218:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135947.610223:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.610230:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.610246:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:2.0:1787135947.610249:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787135947.610253:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.610260:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202991 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135947.610300:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+12:10442:x1873947595417216:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 Request processed in 4031us (4306us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787135947.610309:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:3.0:1787135947.611808:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.612311:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595417472 00000100:00100000:0.0:1787135947.612319:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595417472 00000100:00100000:0.0:1787135947.612357:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:0.0:1787135947.612366:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2361:x1873947595417472:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787135947.612411:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.612430:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182fc expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.612439:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135947.612443:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787135947.612447:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.612488:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182fc expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.612502:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182fc expref: 7 pid: 6672 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135947.612517:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987485dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1873947616411008:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135947.612613:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787135947.614237:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987485dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1873947616411008:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787135947.614259:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135947.614959:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.615194:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595417600 00000100:00100000:2.0:1787135947.615201:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595417600 00010000:00010000:2.0:1787135947.615228:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182fc expref: 8 pid: 6672 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135947.615262:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:2.0:1787135947.615271:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874599f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595417600:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135947.615284:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135947.615304:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182fc expref: 8 pid: 6672 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.615317:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182fc expref: 8 pid: 6672 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.615339:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ee23602/0xf5850c552f20297c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182fc expref: 8 pid: 6672 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.615368:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787135947.615373:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787135947.615379:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.615399:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.615429:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135947.615477:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874599f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595417600:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 207us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135947.615485:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00010000:00010000:3.0:1787135947.615540:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.615561:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.615583:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.615592:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.615600:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.615607:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897c00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787135947.615611:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.615620:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.615632:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.615638:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001d4bcce/0xf5850c552f202998 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135947.615703:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595417472:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 Request processed in 3338us (3900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135947.615711:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:3.0:1787135947.617479:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135947.617560:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595417856 00000100:00100000:2.0:1787135947.617568:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595417856 00000100:00100000:2.0:1787135947.617601:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:2.0:1787135947.617610:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+12:10442:x1873947595417856:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787135947.617673:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20299f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.617687:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20299f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.617697:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20299f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.617921:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.617940:0:7623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202959 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e7 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.617948:0:7623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.617978:0:7623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e7 expref: 13 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.617991:0:7623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202959 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e7 expref: 13 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135947.618004:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874208380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616411136:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135947.618252:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c4e0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135947.619966:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874208380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616411136:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135947.619987:0:7623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135947.620442:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.620515:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595417984 00000100:00100000:0.0:1787135947.620522:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595417984 00010000:00010000:0.0:1787135947.620550:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202959 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e7 expref: 14 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135947.620585:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:0.0:1787135947.620593:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:2360:x1873947595417984:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135947.620606:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135947.620612:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202959 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e7 expref: 14 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.620624:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e7 expref: 14 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.620653:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202959 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182e7 expref: 14 pid: 5822 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.620668:0:7612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:0.0:1787135947.620672:0:7612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.620680:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.620687:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.620711:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135947.620766:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2360:x1873947595417984:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 173us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135947.620778:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00010000:00010000:3.0:1787135947.620824:0:7623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.620833:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787135947.620979:0:7623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1787135947.621138:0:7623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787135947.621181:0:7623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787135947.621247:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874598a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7623:1873947616411264:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787135947.621285:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135947.621305:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987458c240 going to sleep for 11 seconds 00000100:00100000:2.0:1787135947.621869:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616411264 00000100:00100000:2.0:1787135947.621875:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616411264 00000100:00100000:2.0:1787135947.621912:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787135947.621920:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7623:x1873947616411264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787135947.621991:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874599880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7623:x1873947616411264:12345-0@lo:1000:mdt00_003.0 Request processed in 71us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135947.621998:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787135947.622163:0:7623:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787135947.622168:0:7623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e987459b800, transno 4294967303 00000100:00100000:3.0:1787135947.622188:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874598a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7623:1873947616411264:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1787135947.622549:0:7623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1787135947.622595:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874598a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7623:1873947616411392:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787135947.622628:0:7623:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135947.622651:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987458c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135947.622689:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616411392 00000100:00100000:1.0:1787135947.622694:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616411392 00000100:00100000:1.0:1787135947.622724:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787135947.622732:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7623:x1873947616411392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787135947.622873:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7623:x1873947616411392:12345-0@lo:1000:mdt00_003.0 Request processed in 142us (243us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787135947.622880:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787135947.623172:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874598a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7623:1873947616411392:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1787135947.623194:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623203:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623210:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623216:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135947.623220:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623228:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623239:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:3.0:1787135947.623242:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135947.623245:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623250:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2029a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623278:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2028d4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623285:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2028d4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623297:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2028d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623302:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135947.623305:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2028d4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623312:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2028d4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623319:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:3.0:1787135947.623322:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135947.623324:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2028d4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623330:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2028d4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623347:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623358:0:7623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182cb expref: 16 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623367:0:7623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623398:0:7623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182cb expref: 16 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.623420:0:7623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182cb expref: 16 pid: 7623 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135947.623431:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987459ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616411520:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135947.623475:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987458c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135947.626650:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.626712:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595418112 00000100:00100000:0.0:1787135947.626721:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595418112 00010000:00010000:0.0:1787135947.626754:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182cb expref: 17 pid: 7623 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135947.626798:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:0.0:1787135947.626807:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+17:2359:x1873947595418112:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135947.626818:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135947.626825:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182cb expref: 17 pid: 7623 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.626852:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182cb expref: 17 pid: 7623 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.626872:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:0.0:1787135947.626877:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.626887:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.626894:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135947.626909:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135947.626957:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+17:2359:x1873947595418112:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 150us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135947.626964:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00010000:00010000:2.0:1787135947.627033:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2028f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7182cb expref: 16 pid: 7623 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135947.627071:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987459ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616411520:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135947.627094:0:7623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627110:0:7623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627116:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627127:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627134:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627141:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627146:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135947.627150:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627157:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627166:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:2.0:1787135947.627169:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135947.627172:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627178:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db800/0xf5850c552f2029ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627189:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20299f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627199:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20299f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627205:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20299f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627210:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135947.627214:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20299f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627220:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20299f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627229:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1b00) 00010000:00010000:2.0:1787135947.627231:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787135947.627234:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20299f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135947.627239:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20299f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135947.627424:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:10442:x1873947595417856:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 9815us (9950us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787135947.627432:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 84 00000020:00080000:2.0:1787135947.627435:0:7623:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787135947.627490:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787135947.627494:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787135947.627547:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787135947.627564:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787135947.629540:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135947.629599:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595418368 00000100:00100000:0.0:1787135947.629606:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595418368 00000100:00100000:0.0:1787135947.629646:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:0.0:1787135947.629653:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:10442:x1873947595418368:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787135947.630546:0:5825:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787135947.630793:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1787135947.630836:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2029b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.630850:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2029b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.630859:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2029b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.630867:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2029b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.630872:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2029b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.630887:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2029b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135947.630946:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787135947.631023:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+17:10442:x1873947595418368:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 1368us (1485us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1787135947.631031:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000020:00080000:1.0:1787135947.631035:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787135947.631335:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787135947.631342:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2029b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.631349:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afc00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787135947.631353:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2029b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.631360:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2029b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.631371:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e9853809700) 00010000:00010000:3.0:1787135947.631374:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787135947.631378:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2029b4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.631394:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2029b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135947.631410:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135947.631411:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135947.631420:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135947.873603:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787135948.314357:0:11979:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787135948.314367:0:11979:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787135948.314432:0:11979:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787135948.314439:0:11979:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787135948.452545:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135948.452715:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595418624 00000100:00100000:1.0:1787135948.452725:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595418624 00000100:00100000:1.0:1787135948.452823:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:1.0:1787135948.452833:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+17:10452:x1873947595418624:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787135948.452855:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135948.452875:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2029bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718303 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.453143:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f2029c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.453158:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f2029c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.453172:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f2029c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135948.453183:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787135948.453343:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2029bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718303 expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.453367:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f2029c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718303 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.453388:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:1.0:1787135948.453392:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787135948.453395:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533af400, rc 0) 00000100:00100000:1.0:1787135948.453447:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874598700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:10452:x1873947595418624:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 615us (910us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1787135948.453454:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:3.0:1787135948.458346:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135948.458412:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595418752 00000100:00100000:0.0:1787135948.458429:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595418752 00000100:00100000:0.0:1787135948.458491:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:0.0:1787135948.458502:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:10452:x1873947595418752:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:0.0:1787135948.458576:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f2029d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.458595:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f2029d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.458607:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f2029d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.458623:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f2029d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.458630:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f2029d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.458637:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f2029d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.458958:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2029de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.458967:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2029de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.458975:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2029de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787135948.459012:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2029de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459035:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f2029d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459041:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f2029d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459080:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f2029d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459086:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135948.459091:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f2029d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459098:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f2029d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459110:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:0.0:1787135948.459113:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135948.459117:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f2029d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459122:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f2029d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459131:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f2029d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459137:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f2029d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459143:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f2029d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459153:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135948.459156:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f2029d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459162:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f2029d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459170:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98494a1c00) 00010000:00010000:0.0:1787135948.459172:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135948.459175:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f2029d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459180:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f2029d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459194:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2029de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459200:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2029de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459206:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2029de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459211:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135948.459214:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2029de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459220:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2029de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459235:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98494a1f00) 00010000:00010000:0.0:1787135948.459237:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135948.459241:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2029de lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.459246:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2029de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135948.459344:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:10452:x1873947595418752:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 840us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135948.459354:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:1.0:1787135948.515680:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135948.516860:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595419008 00000100:00100000:2.0:1787135948.516873:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595419008 00000100:00100000:2.0:1787135948.516944:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:2.0:1787135948.516954:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:10455:x1873947595419008:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135948.516984:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135948.517005:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f2029e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71830a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517098:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2029ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517117:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2029ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517127:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2029ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517141:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2029f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517148:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2029f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517154:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2029f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517473:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2029fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517482:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2029fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517489:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2029fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135948.517500:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787135948.517597:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2029ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517605:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2029ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517611:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2029ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517617:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135948.517620:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2029ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517627:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2029ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517639:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135948.517642:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135948.517718:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2029ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517726:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2029ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517738:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2029f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517743:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2029f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517749:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2029f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517754:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135948.517763:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2029f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517770:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2029f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.517777:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98532d1000) 00010000:00010000:2.0:1787135948.517780:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135948.518399:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2029f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.518411:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2029f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.518750:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f2029e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71830a expref: 22 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.518773:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2029fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71830a expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.518781:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135948.518784:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787135948.518787:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7800, rc 0) 00000100:00100000:2.0:1787135948.518861:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:10455:x1873947595419008:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1908us (3189us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787135948.518870:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:2.0:1787135948.543561:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135948.543668:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595419136 00000100:00100000:3.0:1787135948.543678:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595419136 00000100:00100000:3.0:1787135948.543743:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:3.0:1787135948.543753:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:10455:x1873947595419136:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:3.0:1787135948.543812:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202a08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.543827:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.543839:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.543861:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.543867:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202a08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.543874:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202a08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.543880:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511dac00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135948.543885:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202a08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.543892:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202a08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.543919:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:3.0:1787135948.543922:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787135948.543926:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202a08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.543933:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202a08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135948.543994:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:10455:x1873947595419136:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 243us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135948.544001:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:3.0:1787135948.555911:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135948.555969:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595419392 00000100:00100000:3.0:1787135948.555979:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595419392 00000100:00100000:3.0:1787135948.556030:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:3.0:1787135948.556040:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9860734c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:10455:x1873947595419392:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1787135948.556555:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9860734c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:10455:x1873947595419392:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 514us (651us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787135948.556564:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:3.0:1787135948.588916:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135948.589214:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595419648 00000100:00100000:2.0:1787135948.589225:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595419648 00000100:00100000:2.0:1787135948.589283:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:2.0:1787135948.589365:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:9984:x1873947595419648:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1787135948.589398:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135948.589417:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718311 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.589515:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.589530:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2029fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71830a expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.589538:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.589570:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2029fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71830a expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.589582:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2029fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71830a expref: 23 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135948.589596:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616411648:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135948.589748:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c4e0780 going to sleep for 11 seconds 00000100:00100000:3.0:1787135948.592792:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135948.592880:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595419776 00000100:00100000:1.0:1787135948.592889:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595419776 00000100:00100000:2.0:1787135948.592985:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616411648:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135948.593011:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.594670:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2029fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71830a expref: 24 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135948.594710:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:1.0:1787135948.595022:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:2359:x1873947595419776:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787135948.595038:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135948.595260:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2029fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71830a expref: 24 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.595277:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2029fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71830a expref: 24 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.595368:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2029fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71830a expref: 24 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.595413:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:1.0:1787135948.595418:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.595428:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.595436:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.595577:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135948.595639:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:2359:x1873947595419776:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 919us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135948.595658:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00010000:00010000:3.0:1787135948.597231:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.597248:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135948.597270:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787135948.597626:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718311 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.597646:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718311 expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.597655:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135948.597658:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787135948.597660:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7000, rc 0) 00000100:00100000:2.0:1787135948.597887:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:9984:x1873947595419648:12345-192.168.203.38@tcp:101:bash.0 Request processed in 8523us (8978us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1787135948.597896:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:3.0:1787135948.601009:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135948.601363:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595420032 00000100:00100000:2.0:1787135948.601382:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595420032 00000100:00100000:2.0:1787135948.601482:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 90 00000100:00100000:2.0:1787135948.601493:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:9984:x1873947595420032:12345-192.168.203.38@tcp:36:bash.0 00010000:00010000:2.0:1787135948.601747:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.601774:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.601784:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787135948.601832:0:7623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787135948.601854:0:7623:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000e40bf0f0 reply state 000000006f0eea94 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135948.601873:0:7623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787135948.601916:0:7623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787135948.602169:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+27:9984:x1873947595420032:12345-192.168.203.38@tcp:36:bash.0 Request processed in 677us (1168us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787135948.602176:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 90 00000020:00080000:2.0:1787135948.602181:0:7623:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1787135948.605856:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135948.605902:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595420160 00000100:00100000:1.0:1787135948.605911:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595420160 00000100:00100000:1.0:1787135948.605961:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:1.0:1787135948.605972:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+27:9984:x1873947595420160:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1787135948.605995:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135948.606015:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f202a2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718318 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.606095:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f202a2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718318 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.606111:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f202a2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718318 expref: 28 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.606221:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135948.606226:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787135948.606230:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533afc00, rc 0) 00000100:00100000:2.0:1787135948.606290:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+28:9984:x1873947595420160:12345-192.168.203.38@tcp:101:bash.0 Request processed in 319us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135948.606303:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 91 00010000:00010000:3.0:1787135948.606355:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.606365:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.606373:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.606389:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135948.606394:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.606402:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.606415:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:3.0:1787135948.606418:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135948.606422:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.606429:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135948.609946:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135948.609993:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595420288 00000100:00100000:2.0:1787135948.610002:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595420288 00000100:00100000:2.0:1787135948.610078:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:2.0:1787135948.610089:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:9984:x1873947595420288:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1787135948.610107:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135948.610127:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007543cd90/0xf5850c552f202a32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71831f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787135948.610151:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8587ca, atime: 0x6a8587c9, ctime: 0x6a8587ca, blocks: 0xb 00010000:00010000:2.0:1787135948.610170:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=308s v=(0 0) 00010000:00010000:2.0:1787135948.610175:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135948.610182:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007543cd90/0xf5850c552f202a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71831f expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.610219:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007543cd90/0xf5850c552f202a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71831f expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.610231:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7a00, rc 0) 00000100:00100000:0.0:1787135948.610390:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:9984:x1873947595420288:12345-192.168.203.38@tcp:101:bash.0 Request processed in 302us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135948.610399:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:1.0:1787135948.613641:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135948.613871:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595420416 00000100:00100000:2.0:1787135948.613881:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595420416 00002000:00010000:2.0:1787135948.613920:0:6678:0:(ofd_dev.c:2828:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1787135948.613925:0:6678:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e98769c3b80 with x1873947595420416 ext(0->18446744073709551615) 00002000:00010000:2.0:1787135948.613937:0:6678:0:(ofd_dev.c:2833:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e98769c3b80. 00000100:00100000:2.0:1787135948.614014:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:2.0:1787135948.614025:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595420416:12345-192.168.203.38@tcp:10:bash.0 00002000:00010000:2.0:1787135948.614482:0:6678:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1787135948.614486:0:6678:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787135946 -> 1787135948 00002000:00010000:2.0:1787135948.614488:0:6678:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787135945 -> 1787135945 00002000:00010000:2.0:1787135948.614490:0:6678:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787135946 -> 1787135948 00002000:00010000:2.0:1787135948.614493:0:6678:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787135948.614549:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595420416:12345-192.168.203.38@tcp:10:bash.0 Request processed in 525us (917us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787135948.614557:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00002000:00010000:2.0:1787135948.614561:0:6678:0:(ofd_dev.c:2828:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1787135948.614564:0:6678:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e98769c3b80 with x1873947595420416 ext(0->18446744073709551615) 00002000:00010000:2.0:1787135948.614569:0:6678:0:(ofd_dev.c:2833:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e98769c3b80. 00000100:00100000:1.0:1787135948.726164:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135948.726273:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595420544 00000100:00100000:0.0:1787135948.726282:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595420544 00000100:00100000:0.0:1787135948.726350:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:0.0:1787135948.726366:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+27:10470:x1873947595420544:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:0.0:1787135948.726452:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202a39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726469:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726480:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726495:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202a40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726516:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726523:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726794:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726803:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726811:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787135948.726847:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726859:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202a39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726866:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202a39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726873:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726879:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135948.726883:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202a39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726890:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202a39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726908:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:0.0:1787135948.726911:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135948.726916:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202a39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726921:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202a39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726947:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202a40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726952:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202a40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726958:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726963:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135948.726966:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202a40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726972:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202a40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726979:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98494a1f00) 00010000:00010000:0.0:1787135948.726981:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135948.726984:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202a40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.726990:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202a40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.727014:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.727021:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202a47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.727026:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.727030:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135948.727033:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.727038:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202a47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.728965:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:0.0:1787135948.728977:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135948.728986:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202a47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.728996:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202a47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135948.731505:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+27:10470:x1873947595420544:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 3303us (3511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135948.731520:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:1.0:1787135948.772718:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135948.772821:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595420800 00000100:00100000:2.0:1787135948.772832:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595420800 00000100:00100000:2.0:1787135948.772905:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:2.0:1787135948.772914:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+27:10473:x1873947595420800:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135948.772934:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135948.772954:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718326 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773041:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202a55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773116:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773128:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773144:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773151:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773157:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773669:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773680:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773688:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135948.773709:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787135948.773809:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202a55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773818:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202a55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773825:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202a55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773832:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135948.773836:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202a55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773844:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202a55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773857:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135948.773860:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135948.773865:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202a55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773871:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202a55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773883:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773890:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773906:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773912:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135948.773914:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773920:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773928:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98532d1a00) 00010000:00010000:2.0:1787135948.773931:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135948.773933:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773938:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202a5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773979:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718326 expref: 30 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.773993:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718326 expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.774000:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135948.774002:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787135948.774005:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7800, rc 0) 00000100:00100000:2.0:1787135948.774874:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+29:10473:x1873947595420800:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1956us (2158us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787135948.774896:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:1.0:1787135948.780453:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135948.780522:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595420928 00000100:00100000:2.0:1787135948.780532:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595420928 00000100:00100000:2.0:1787135948.780625:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:2.0:1787135948.780635:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+29:10473:x1873947595420928:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:2.0:1787135948.780698:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.780714:0:7623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718311 expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.780724:0:7623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.780754:0:7623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718311 expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.780780:0:7623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718311 expref: 29 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135948.780794:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616411776:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135948.780887:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c4e0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787135948.785432:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135948.785505:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595421184 00000100:00100000:3.0:1787135948.785515:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595421184 00000100:00100000:3.0:1787135948.785574:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:3.0:1787135948.785585:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+30:5597:x1873947595421184:12345-192.168.203.38@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787135948.785922:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+31:5597:x1873947595421184:12345-192.168.203.38@tcp:35:ldlm_bl.0 Request processed in 339us (500us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787135948.785931:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:1.0:1787135948.788303:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135948.788427:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595421312 00000100:00100000:0.0:1787135948.788436:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595421312 00010000:00010000:0.0:1787135948.788472:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718311 expref: 31 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135948.788514:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:0.0:1787135948.788524:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+31:2360:x1873947595421312:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135948.788551:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135948.788558:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718311 expref: 31 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.788571:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718311 expref: 31 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.788592:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:0.0:1787135948.788597:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.788605:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.788613:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.788631:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135948.788700:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+31:2360:x1873947595421312:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 177us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135948.788708:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00010000:00010000:2.0:1787135948.788761:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718311 expref: 30 pid: 5822 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135948.789427:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616411776:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135948.789451:0:7623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.789469:0:7623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.789476:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.789505:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.789513:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.789520:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.789526:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135948.789530:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.789538:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.789549:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135948.789552:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787135948.789556:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.789561:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202a71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135948.789610:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+29:10473:x1873947595420928:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 8976us (9163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135948.789626:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:1.0:1787135948.793508:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135948.793633:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595421568 00000100:00100000:3.0:1787135948.793643:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595421568 00000100:00100000:3.0:1787135948.793699:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:3.0:1787135948.793709:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+29:10473:x1873947595421568:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1787135948.793944:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+30:10473:x1873947595421568:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 236us (444us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787135948.793953:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00010000:00010000:3.0:1787135948.888492:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135948.889015:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135948.889164:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595421824 00000100:00100000:1.0:1787135948.889174:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595421824 00000100:00100000:1.0:1787135948.889232:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:1.0:1787135948.889249:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+30:10484:x1873947595421824:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:1.0:1787135948.889271:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135948.889300:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202a78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71832d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889368:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202a7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889391:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202a7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889402:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202a7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889417:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202a86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889424:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889430:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889719:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202a8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889729:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889735:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135948.889746:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1787135948.889831:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202a7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889838:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202a7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889845:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202a7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889851:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135948.889855:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202a7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889863:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202a7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889875:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:1.0:1787135948.889878:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135948.889883:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202a7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889900:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202a7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889919:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202a86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889925:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202a86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889932:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202a86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889937:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aee00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135948.889940:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202a86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889946:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202a86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889953:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9853809e00) 00010000:00010000:1.0:1787135948.889956:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135948.889958:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202a86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.889963:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202a86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.890006:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202a78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71832d expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.890020:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202a8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71832d expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.890033:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:1.0:1787135948.890036:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787135948.890038:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533aea00, rc 0) 00000100:00100000:1.0:1787135948.890977:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:10484:x1873947595421824:12345-192.168.203.38@tcp:101:cat.0 Request processed in 1730us (1962us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1787135948.890987:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:2.0:1787135948.898820:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135948.898910:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595422080 00000100:00100000:3.0:1787135948.898920:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595422080 00000100:00100000:3.0:1787135948.898981:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1787135948.898991:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:10484:x1873947595422080:12345-192.168.203.38@tcp:35:cat.0 00000100:00100000:3.0:1787135948.899250:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+33:10484:x1873947595422080:12345-192.168.203.38@tcp:35:cat.0 Request processed in 260us (441us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787135948.899258:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:2.0:1787135948.914860:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135948.914989:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595422336 00000100:00100000:3.0:1787135948.914999:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595422336 00000100:00100000:2.0:1787135948.915157:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:2.0:1787135948.915169:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+33:10485:x1873947595422336:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:2.0:1787135948.915235:0:7623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787135948.915260:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202a8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71832d expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.915286:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718326 expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.915300:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f202a2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718318 expref: 31 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.915309:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135948.915319:0:7623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135948.915340:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.915353:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.915363:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.915388:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202aa2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.915418:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.915425:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.915714:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202aa9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.915737:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202aa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.915744:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202aa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787135948.917428:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1787135948.917441:0:7623:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 308860392461ns, next at 309860389918ns, rc = 0 00010000:00010000:2.0:1787135948.917510:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ab0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917524:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ab0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917535:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ab0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917543:0:7623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ab0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917550:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ab0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917568:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ab0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917595:0:7623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787135948.917616:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202aa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917623:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202aa9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917629:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202aa9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917635:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135948.917640:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202aa9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917647:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202aa9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917659:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1d00) 00010000:00010000:2.0:1787135948.917662:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787135948.917666:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202aa9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917672:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202aa9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917690:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917696:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917708:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917714:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135948.917717:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917723:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917731:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135948.917733:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135948.917736:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135948.917742:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202a9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787135948.917752:0:7623:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000000827fa82 reply state 0000000074d61de1 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135948.917761:0:7623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787135948.918028:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787135948.918035:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ab0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.918042:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6e00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787135948.918063:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ab0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.918087:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ab0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.918096:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e98532d1d00) 00010000:00010000:3.0:1787135948.918098:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787135948.918101:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ab0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.918107:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ab0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.918122:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135948.918125:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135948.918126:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135948.918503:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874209500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:10485:x1873947595422336:12345-192.168.203.38@tcp:36:rm.0 Request processed in 3332us (3647us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1787135948.918512:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 96 00010000:00010000:3.0:1787135948.926637:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.926655:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202aa2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.926662:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.926669:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135948.926674:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.926682:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202aa2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.926698:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98532d1a00) 00010000:00010000:3.0:1787135948.926714:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135948.926719:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202aa2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.926725:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202aa2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135948.950890:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135948.952251:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595422592 00000100:00100000:0.0:1787135948.952264:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595422592 00000100:00100000:0.0:1787135948.952337:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:0.0:1787135948.952349:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+31:10491:x1873947595422592:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1787135948.952386:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135948.952406:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202ab7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718334 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.952545:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202abe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.952560:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202abe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.952571:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202abe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.952584:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202ac5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.952591:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202ac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.952597:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202ac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787135948.953128:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1787135948.953279:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202acc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.953288:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202acc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.953297:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202acc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.953329:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202abe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.953345:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202abe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.953351:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202abe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.953356:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135948.953360:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202abe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.953367:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202abe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.953390:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:0.0:1787135948.953392:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135948.953397:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202abe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.953402:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202abe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787135948.953413:0:5822:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000d29c639f reply state 00000000e4b730da transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202ac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135948.953420:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787135948.953447:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202ab7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718334 expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.953457:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202acc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718334 expref: 33 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.953475:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:0.0:1787135948.953478:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787135948.953480:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897400, rc 0) 00000100:00100000:0.0:1787135948.953554:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874208700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:10491:x1873947595422592:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1207us (2673us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787135948.953560:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 97 00010000:00010000:3.0:1787135948.956649:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202ac5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.956665:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202ac5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.956678:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202ac5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.956684:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135948.956689:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202ac5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.956697:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202ac5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.956712:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98494a1f00) 00010000:00010000:3.0:1787135948.956715:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135948.956718:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202ac5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.956724:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202ac5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135948.959093:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135948.959178:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595422720 00000100:00100000:3.0:1787135948.959201:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595422720 00000100:00100000:3.0:1787135948.959267:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:3.0:1787135948.959278:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2361:x1873947595422720:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1787135948.959299:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135948.959325:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056ad2d71/0xf5850c552f202ada lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71833b expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787135948.959351:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787135948.959369:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=308s v=(0 0) 00010000:00010000:3.0:1787135948.959384:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787135948.959392:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056ad2d71/0xf5850c552f202ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71833b expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.959412:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000056ad2d71/0xf5850c552f202ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71833b expref: 6 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135948.959424:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db800, rc 0) 00000100:00100000:3.0:1787135948.959485:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595422720:12345-192.168.203.38@tcp:101:bash.0 Request processed in 209us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135948.959492:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00080000:0.0:1787135948.959571:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787135948.963040:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135948.963169:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595422848 00000100:00100000:1.0:1787135948.963179:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595422848 00000100:00100000:1.0:1787135948.963228:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:1.0:1787135948.963239:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:10491:x1873947595422848:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1787135948.963256:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135948.963274:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718342 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.963307:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056ad2d71/0xf5850c552f202ada lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71833b expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.963315:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787135948.963320:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787135948.963325:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.963357:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056ad2d71/0xf5850c552f202ada lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71833b expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.963400:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056ad2d71/0xf5850c552f202ada lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71833b expref: 7 pid: 6673 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135948.963414:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98769c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6674:1873947616411904:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787135948.963507:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f78cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135948.966000:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135948.966090:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595422976 00000100:00100000:0.0:1787135948.966099:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595422976 00010000:00010000:0.0:1787135948.966136:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056ad2d71/0xf5850c552f202ada lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71833b expref: 8 pid: 6673 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135948.966172:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:0.0:1787135948.966183:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595422976:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135948.966198:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135948.966218:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056ad2d71/0xf5850c552f202ada lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71833b expref: 8 pid: 6673 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.966230:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056ad2d71/0xf5850c552f202ada lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71833b expref: 8 pid: 6673 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.966255:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135948.966260:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135948.966267:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.966291:0:7612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135948.966326:0:7612:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135948.966339:0:7612:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987485f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7612:1873947616412032:192.168.203.38@tcp:105: 00000100:00100000:0.0:1787135948.966459:0:7612:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c2d80 going to sleep for 11 seconds 00010000:00010000:1.0:1787135948.966673:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056ad2d71/0xf5850c552f202ada lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71833b expref: 8 pid: 6673 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135948.966687:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98769c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6674:1873947616411904:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787135948.966712:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135948.966816:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533aee00, rc 0) 00000100:00100000:1.0:1787135948.966842:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:10491:x1873947595422848:12345-192.168.203.38@tcp:101:bash.0 Request processed in 3607us (3820us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135948.966848:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:0.0:1787135948.970036:0:7612:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987485f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7612:1873947616412032:192.168.203.38@tcp:105: 00010000:00010000:0.0:1787135948.970174:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135948.970221:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595422976:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 4038us (4228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135948.970231:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:3.0:1787135948.971410:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135948.971490:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595423232 00000100:00100000:2.0:1787135948.971507:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595423232 00000100:00100000:2.0:1787135948.971560:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:2.0:1787135948.971570:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+33:10491:x1873947595423232:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:2.0:1787135948.972198:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:10491:x1873947595423232:12345-192.168.203.38@tcp:35:bash.0 Request processed in 624us (786us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787135948.972207:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:2.0:1787135949.142468:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.142554:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595423360 00000100:00100000:3.0:1787135949.142563:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595423360 00000100:00100000:3.0:1787135949.142670:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:3.0:1787135949.142682:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:10507:x1873947595423360:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135949.142705:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135949.142746:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202ae8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718349 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.142808:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f202aef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.142823:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f202aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.142836:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f202aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135949.142893:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787135949.142898:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787135949.142920:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f202aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.142957:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202ae8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718349 expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.142975:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f202aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718349 expref: 35 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.142984:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:3.0:1787135949.142988:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787135949.142991:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db400, rc 0) 00000100:00100000:3.0:1787135949.143103:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874208000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+35:10507:x1873947595423360:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 424us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135949.143111:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00080000:0.0:1787135949.143187:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135949.152580:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.152782:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595423616 00000100:00100000:2.0:1787135949.152793:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595423616 00000100:00100000:2.0:1787135949.152883:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:2.0:1787135949.152895:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+35:10507:x1873947595423616:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135949.152916:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135949.152935:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202af6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718350 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.153032:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202afd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.153079:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.153092:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135949.153105:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787135949.153398:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202af6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718350 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.153417:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202afd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718350 expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.153439:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:2.0:1787135949.153442:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787135949.153445:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6800, rc 0) 00000100:00100000:2.0:1787135949.153556:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+37:10507:x1873947595423616:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 664us (985us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1787135949.153564:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:1.0:1787135949.168788:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.168948:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595423872 00000100:00100000:2.0:1787135949.168958:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595423872 00000100:00100000:2.0:1787135949.169015:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:2.0:1787135949.169025:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+37:10507:x1873947595423872:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135949.169073:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135949.169093:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202b0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718357 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.169207:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202b12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.169220:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.169231:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202b12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135949.169243:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787135949.169367:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202b0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718357 expref: 40 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.169415:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202b12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718357 expref: 39 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.169423:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:2.0:1787135949.169425:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787135949.169429:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7800, rc 0) 00000100:00100000:2.0:1787135949.169483:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+39:10507:x1873947595423872:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 459us (704us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787135949.169490:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:2.0:1787135949.180241:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.180486:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.180545:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595424128 00000100:00100000:3.0:1787135949.180566:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595424128 00000100:00100000:3.0:1787135949.180621:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:3.0:1787135949.180631:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2362:x1873947595424128:12345-192.168.203.38@tcp:1:lfs.0 00010000:00010000:3.0:1787135949.180684:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.180705:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.180714:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787135949.180832:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787135949.180838:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135949.180875:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595424000 00010000:00010000:3.0:1787135949.180876:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135949.180882:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595424000 00010000:00010000:3.0:1787135949.180896:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 6 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135949.180922:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874599f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1873947616412160:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787135949.180931:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1787135949.180941:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+39:2359:x1873947595424000:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787135949.180952:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135949.180978:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202afd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718350 expref: 39 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.181001:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:1.0:1787135949.181007:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135949.181021:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987458c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787135949.181038:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874209c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+38:2359:x1873947595424000:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 98us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135949.181078:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:3.0:1787135949.183762:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874599f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1873947616412160:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135949.183791:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.187116:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135949.187824:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595424256 00000100:00100000:0.0:1787135949.187836:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595424256 00002000:00100000:0.0:1787135949.187890:0:6680:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e9874209180 x1873947595424256/t0(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:375/0 lens 504/0 e 0 to 0 dl 1787135960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787135949.187901:0:6680:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e9874209180 with x1873947595424256 ext(0->8) 00010000:00010000:0.0:1787135949.187911:0:6680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 7 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.187927:0:6680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 7 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787135949.187948:0:6680:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e9874209180 00000100:00100000:0.0:1787135949.187984:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:0.0:1787135949.187994:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595424256:12345-192.168.203.38@tcp:4:lfs.0 00000100:00100000:0.0:1787135949.188453:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874209180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2360:x1873947595424256:12345-192.168.203.38@tcp:4:lfs.0 Request processed in 459us (1344us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787135949.188461:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00002000:00100000:0.0:1787135949.188468:0:6680:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e9874209180 x1873947595424256/t4294967302(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:375/0 lens 504/448 e 0 to 0 dl 1787135960 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787135949.188476:0:6680:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e9874209180 with x1873947595424256 ext(0->8) 00010000:00010000:0.0:1787135949.188482:0:6680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 9 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.188493:0:6680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 9 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787135949.188499:0:6680:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e9874209180 00000100:00100000:0.0:1787135949.201312:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.201391:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595424384 00000100:00100000:2.0:1787135949.201401:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595424384 00010000:00010000:2.0:1787135949.201437:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 9 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.201486:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:2.0:1787135949.201497:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2360:x1873947595424384:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135949.201512:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787135949.201529:0:5807:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787135949.201531:0:5807:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787135948 00002000:00010000:2.0:1787135949.201532:0:5807:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787135949 00002000:00010000:2.0:1787135949.201534:0:5807:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787135948 00010000:00010000:2.0:1787135949.201589:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 9 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.201611:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 9 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.201634:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f202ae1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718342 expref: 9 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.201648:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787135949.201651:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787135949.201655:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.201662:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.201688:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135949.201739:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595424384:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 245us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.201745:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00010000:00010000:3.0:1787135949.201757:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.201771:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.201797:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.201806:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.201815:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.201832:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511dac00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787135949.201837:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.201846:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.201859:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.201878:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e642e87a/0xf5850c552f202b20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135949.201934:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2362:x1873947595424128:12345-192.168.203.38@tcp:1:lfs.0 Request processed in 21305us (21448us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135949.201940:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:0.0:1787135949.207850:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.209245:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595424640 00000100:00100000:3.0:1787135949.209256:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595424640 00000100:00100000:3.0:1787135949.209321:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:3.0:1787135949.209332:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9860736c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+38:10507:x1873947595424640:12345-192.168.203.38@tcp:35:lfs.0 00000004:00010000:3.0:1787135949.209409:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202b12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718357 expref: 38 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787135949.209687:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1787135949.209735:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1787135949.210120:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1787135949.210173:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.210189:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202acc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718334 expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.210197:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.210229:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202acc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718334 expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.210260:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202acc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718334 expref: 42 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135949.210274:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987459a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1873947616412288:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135949.210377:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987458c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787135949.215748:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.216220:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987459a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1873947616412288:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135949.216260:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135949.216263:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595424768 00000100:00100000:0.0:1787135949.216272:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595424768 00010000:00010000:0.0:1787135949.216313:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202acc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718334 expref: 43 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135949.216344:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:0.0:1787135949.216367:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+43:2360:x1873947595424768:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135949.216511:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135949.216520:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202acc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718334 expref: 43 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.216534:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202acc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718334 expref: 43 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.216556:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202acc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718334 expref: 43 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.216571:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:0.0:1787135949.216576:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.216585:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.216593:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.216630:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787135949.216752:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.216761:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787135949.216873:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1787135949.217075:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787135949.217246:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+44:2360:x1873947595424768:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 878us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135949.217255:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1787135949.217406:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987459a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1873947616412416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787135949.217456:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135949.217492:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9846145180 going to sleep for 11 seconds 00000100:00100000:1.0:1787135949.217543:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616412416 00000100:00100000:1.0:1787135949.217549:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616412416 00000100:00100000:1.0:1787135949.217606:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787135949.217615:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5825:x1873947616412416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787135949.217679:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5825:x1873947616412416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 66us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135949.217686:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787135949.217754:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987459a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1873947616412416:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1787135949.218264:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787135949.218478:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1787135949.218539:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987459a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1873947616412544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787135949.218570:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135949.218632:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987458c180 going to sleep for 11 seconds 00000100:00100000:1.0:1787135949.218665:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616412544 00000100:00100000:1.0:1787135949.218670:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616412544 00000100:00100000:1.0:1787135949.218704:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787135949.218711:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5825:x1873947616412544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787135949.218845:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5825:x1873947616412544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 134us (272us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1787135949.218854:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787135949.218869:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987459a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1873947616412544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787135949.218910:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1787135949.218962:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.218972:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.218988:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.218994:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511dac00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135949.218998:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.219006:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.219021:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:3.0:1787135949.219025:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787135949.219028:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.219034:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202b27 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787135949.219908:0:5825:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787135949.220041:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:3.0:1787135949.220082:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 309163033350ns, next at 310163030636ns, rc = 0 00000001:00080000:3.0:1787135949.220090:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1787135949.220142:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:3.0:1787135949.220146:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787135949.220163:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202b12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718357 expref: 46 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135949.220262:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9860736c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+45:10507:x1873947595424640:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 10931us (12420us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1787135949.220277:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000020:00080000:3.0:1787135949.220282:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787135949.225898:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.228553:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595424896 00000100:00100000:2.0:1787135949.228567:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595424896 00000100:00100000:2.0:1787135949.228686:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:2.0:1787135949.228697:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+45:10507:x1873947595424896:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135949.228729:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135949.228750:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202b2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71835e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.228831:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202b2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71835e expref: 46 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.228845:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202b2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71835e expref: 46 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.228863:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135949.228866:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787135949.228869:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7c00, rc 0) 00000100:00100000:2.0:1787135949.228943:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+46:10507:x1873947595424896:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 248us (3053us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.228950:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:1.0:1787135949.233078:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.233314:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595425152 00000100:00100000:2.0:1787135949.233325:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595425152 00000100:00100000:2.0:1787135949.234189:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:2.0:1787135949.234206:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+46:10507:x1873947595425152:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1787135949.235611:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+47:10507:x1873947595425152:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 1405us (2566us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787135949.235622:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:3.0:1787135949.317484:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.318000:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595425280 00000100:00100000:2.0:1787135949.318011:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595425280 00000100:00100000:2.0:1787135949.318105:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:2.0:1787135949.318116:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+47:10517:x1873947595425280:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:2.0:1787135949.318186:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318217:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318229:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318245:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318253:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318259:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318346:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318354:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318361:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787135949.318409:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318422:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318429:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318445:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318451:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135949.318455:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318463:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318473:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135949.318476:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135949.318480:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318486:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318499:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318505:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318511:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318515:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135949.318518:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318533:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318541:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98532d1900) 00010000:00010000:2.0:1787135949.318543:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135949.318546:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318551:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318565:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318572:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318577:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318582:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135949.318585:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318591:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318598:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135949.318600:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135949.318603:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.318618:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.318687:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+47:10517:x1873947595425280:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 572us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.318695:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:0.0:1787135949.368425:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.368583:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595425536 00000100:00100000:2.0:1787135949.368594:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595425536 00000100:00100000:2.0:1787135949.368657:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:2.0:1787135949.368665:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+47:10520:x1873947595425536:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135949.368685:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135949.368712:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718365 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.368792:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.368806:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.368818:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.368831:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.368838:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.368861:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.368994:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369003:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369010:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135949.369020:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787135949.369143:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369151:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369157:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369163:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135949.369168:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369176:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369187:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135949.369190:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135949.369203:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369210:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202b51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369224:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369470:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369478:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369483:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135949.369486:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369492:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369501:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98532d1900) 00010000:00010000:2.0:1787135949.369503:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135949.369506:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369512:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369554:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718365 expref: 50 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369583:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718365 expref: 49 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.369590:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135949.369592:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787135949.369594:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7400, rc 0) 00000100:00100000:2.0:1787135949.369656:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+49:10520:x1873947595425536:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 991us (1240us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1787135949.369664:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 103 00000100:00100000:1.0:1787135949.372964:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.373336:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595425664 00000100:00100000:2.0:1787135949.373346:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595425664 00000100:00100000:2.0:1787135949.373427:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:2.0:1787135949.373437:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+49:10520:x1873947595425664:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:2.0:1787135949.373506:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202b6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.373522:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.373533:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.373567:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202b6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.373575:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202b6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.373598:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.373604:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135949.373609:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202b6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.373616:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202b6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.373632:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135949.373636:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787135949.373641:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202b6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.373646:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202b6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.373724:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+49:10520:x1873947595425664:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 288us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.373732:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:3.0:1787135949.375898:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135949.378703:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595425920 00000100:00100000:0.0:1787135949.378978:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595425920 00000100:00100000:0.0:1787135949.379149:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:0.0:1787135949.379161:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+49:10520:x1873947595425920:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1787135949.379401:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+50:10520:x1873947595425920:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 241us (3509us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787135949.379410:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:0.0:1787135949.454538:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135949.456763:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595426176 00000100:00100000:1.0:1787135949.456778:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595426176 00000100:00100000:1.0:1787135949.456885:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:1.0:1787135949.456897:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+50:10530:x1873947595426176:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1787135949.456923:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135949.456928:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787135949.456955:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f202aef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718349 expref: 50 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.456975:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:1.0:1787135949.456980:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787135949.456995:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202b74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71836c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.457140:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.457156:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718365 expref: 50 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.457165:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.457198:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718365 expref: 50 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.457211:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718365 expref: 50 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135949.457224:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98769c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1873947616412672:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787135949.457335:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f78cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135949.460794:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98769c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1873947616412672:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135949.460827:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135949.463175:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.463422:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595426304 00000100:00100000:2.0:1787135949.463431:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595426304 00010000:00010000:2.0:1787135949.463472:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718365 expref: 51 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.463535:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1787135949.463546:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+51:2359:x1873947595426304:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135949.463561:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135949.463569:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718365 expref: 51 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.463582:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718365 expref: 51 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.463604:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718365 expref: 51 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.463621:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135949.463626:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.463636:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.463644:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.463676:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135949.463731:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+50:2359:x1873947595426304:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 186us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.463739:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00010000:00010000:1.0:1787135949.463758:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.463781:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135949.463800:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787135949.463951:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202b74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71836c expref: 51 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.464500:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71836c expref: 50 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.464511:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:1.0:1787135949.464514:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787135949.464516:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533afa00, rc 0) 00000100:00100000:1.0:1787135949.464549:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+50:10530:x1873947595426176:12345-192.168.203.38@tcp:101:bash.0 Request processed in 7655us (10022us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1787135949.464556:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 105 00000100:00100000:1.0:1787135949.470487:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.470855:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595426560 00000100:00100000:2.0:1787135949.470878:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595426560 00000100:00100000:2.0:1787135949.470935:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 106 00000100:00100000:2.0:1787135949.470945:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+50:10530:x1873947595426560:12345-192.168.203.38@tcp:36:bash.0 00010000:00010000:2.0:1787135949.471222:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.471252:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.471264:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787135949.471311:0:7623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787135949.471335:0:7623:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000d16e07d6 reply state 000000006e941c03 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.471345:0:7623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787135949.471442:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10530:x1873947595426560:12345-192.168.203.38@tcp:36:bash.0 Request processed in 497us (963us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787135949.471450:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 106 00000020:00080000:2.0:1787135949.471455:0:7623:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787135949.474861:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:0.0:1787135949.475154:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.475166:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.475175:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.475181:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135949.475186:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.475195:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.475216:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:0.0:1787135949.475219:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135949.475223:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.475230:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202b89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.475328:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595426688 00000100:00100000:2.0:1787135949.475340:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595426688 00000100:00100000:2.0:1787135949.476186:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:2.0:1787135949.476199:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:10530:x1873947595426688:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1787135949.476223:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135949.476240:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202b90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718373 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.476314:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.476336:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71836c expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.476344:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.476387:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71836c expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.476401:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71836c expref: 53 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.476415:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616412800:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135949.476504:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c4e0840 going to sleep for 11 seconds 00000100:00100000:1.0:1787135949.478419:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616412800:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787135949.478443:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135949.480016:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135949.480138:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595426816 00000100:00100000:1.0:1787135949.480147:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595426816 00010000:00010000:1.0:1787135949.480184:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71836c expref: 54 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135949.480241:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:1.0:1787135949.480251:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:2360:x1873947595426816:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787135949.480266:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135949.480274:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71836c expref: 54 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.480287:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71836c expref: 54 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.480308:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202b7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71836c expref: 54 pid: 5823 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.480324:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:1.0:1787135949.480330:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.480339:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.480348:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.480381:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135949.480431:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:2360:x1873947595426816:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 181us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135949.480439:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00010000:00010000:2.0:1787135949.480531:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.480539:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135949.480581:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787135949.480586:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135949.480604:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.480634:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202b90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718373 expref: 53 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.480650:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718373 expref: 52 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.480664:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135949.480667:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787135949.480670:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6e00, rc 0) 00000100:00100000:2.0:1787135949.480695:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:10530:x1873947595426688:12345-192.168.203.38@tcp:101:bash.0 Request processed in 4499us (5844us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.480701:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 107 00000100:00100000:0.0:1787135949.486530:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.486607:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595427072 00000100:00100000:3.0:1787135949.486617:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595427072 00000100:00100000:3.0:1787135949.486673:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:3.0:1787135949.486683:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:10530:x1873947595427072:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:3.0:1787135949.486952:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10530:x1873947595427072:12345-192.168.203.38@tcp:35:bash.0 Request processed in 269us (429us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787135949.486975:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:3.0:1787135949.545680:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.545780:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595427200 00000100:00100000:2.0:1787135949.545789:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595427200 00000100:00100000:2.0:1787135949.545845:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:2.0:1787135949.545854:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:10536:x1873947595427200:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135949.545877:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135949.545896:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71837a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.545958:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202ba5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.545974:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.545986:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135949.546040:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787135949.546044:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135949.546104:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202ba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.546146:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202b9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71837a expref: 55 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.546165:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202ba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71837a expref: 54 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.546174:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135949.546177:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787135949.546180:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6400, rc 0) 00000100:00100000:2.0:1787135949.546238:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10536:x1873947595427200:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 385us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.546245:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 108 00000100:00100000:2.0:1787135949.548645:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135949.548778:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595427328 00000100:00100000:1.0:1787135949.548798:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595427328 00000100:00100000:1.0:1787135949.548851:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:1.0:1787135949.548861:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10536:x1873947595427328:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787135949.548881:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135949.548899:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202bac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718381 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.548960:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202bb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.548975:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.548986:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549000:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202bba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549007:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549013:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549137:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202bc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549147:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549155:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135949.549194:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787135949.549199:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787135949.549216:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549228:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549237:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549244:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202bb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549251:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549258:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aee00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135949.549263:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549271:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202bb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549283:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:1.0:1787135949.549287:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135949.549291:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202bb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549298:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202bb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549321:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202bba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549327:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202bba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549334:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202bba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549339:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135949.549343:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202bba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549349:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202bba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549357:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e9853809e00) 00010000:00010000:1.0:1787135949.549360:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135949.549363:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202bba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549381:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202bba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549410:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202bac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718381 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549423:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718381 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.549442:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:1.0:1787135949.549445:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787135949.549448:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533ae800, rc 0) 00000100:00100000:1.0:1787135949.549507:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10536:x1873947595427328:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 647us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135949.549514:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 109 00000100:00100000:0.0:1787135949.551764:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135949.551815:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.551918:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595427712 00000100:00100000:2.0:1787135949.551926:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595427712 00000100:00100000:2.0:1787135949.551976:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1787135949.551985:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:2360:x1873947595427712:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135949.551999:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135949.552021:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202bc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718381 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.552038:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135949.552041:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135949.552109:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:2360:x1873947595427712:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 124us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.552116:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1787135949.552154:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595427584 00000100:00100000:3.0:1787135949.552158:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595427584 00000100:00100000:3.0:1787135949.552192:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:3.0:1787135949.552200:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10536:x1873947595427584:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135949.552215:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135949.552228:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202bc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718388 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.552317:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.552329:0:7623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718373 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.552338:0:7623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.552380:0:7623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718373 expref: 55 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.552391:0:7623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718373 expref: 55 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135949.552402:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987459b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616412928:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135949.552446:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98604570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135949.558111:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135949.558337:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595427840 00000100:00100000:0.0:1787135949.558347:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595427840 00010000:00010000:0.0:1787135949.558397:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718373 expref: 56 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.558441:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987459b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616412928:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135949.558445:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:0.0:1787135949.558461:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:2359:x1873947595427840:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135949.558473:0:7623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.558476:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135949.558488:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718373 expref: 56 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.558502:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718373 expref: 56 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.558525:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202b97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718373 expref: 56 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.558541:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:0.0:1787135949.558546:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.558556:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.558579:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.558609:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135949.558659:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457cb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:2359:x1873947595427840:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 201us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135949.558667:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00010000:00010000:2.0:1787135949.559430:0:7623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.559441:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135949.559464:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787135949.559605:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f202bc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718388 expref: 56 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.559622:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718388 expref: 55 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.559630:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135949.559633:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787135949.559635:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dac00, rc 0) 00000100:00100000:2.0:1787135949.559712:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10536:x1873947595427584:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 7511us (7895us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1787135949.559720:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 110 00000100:00100000:3.0:1787135949.568788:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.568853:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595428096 00000100:00100000:2.0:1787135949.568863:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595428096 00000100:00100000:2.0:1787135949.568931:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:2.0:1787135949.568943:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10536:x1873947595428096:12345-192.168.203.38@tcp:103:lfs.0 00010000:00010000:2.0:1787135949.568959:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135949.568997:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202b2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71835e expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.569016:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135949.569021:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135949.569101:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874598000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10536:x1873947595428096:12345-192.168.203.38@tcp:103:lfs.0 Request processed in 160us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.569111:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1787135949.570525:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.570572:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595428224 00000100:00100000:2.0:1787135949.570579:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595428224 00000100:00100000:2.0:1787135949.570627:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 111 00000100:00100000:2.0:1787135949.570635:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10536:x1873947595428224:12345-192.168.203.38@tcp:58:lfs.0 00010000:00010000:2.0:1787135949.570903:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202bdd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.570921:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202bdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.570932:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202bdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787135949.571160:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1787135949.571251:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10536:x1873947595428224:12345-192.168.203.38@tcp:58:lfs.0 Request processed in 616us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.571259:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 111 00000100:00100000:3.0:1787135949.582993:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.583262:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595428352 00000100:00100000:2.0:1787135949.583271:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595428352 00000100:00100000:2.0:1787135949.583332:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 112 00000100:00100000:2.0:1787135949.583343:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:10536:x1873947595428352:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135949.583387:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135949.583409:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202be4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71838f expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.583463:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202bdd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.583474:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202be4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71838f expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.583492:0:5821:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202bdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.583505:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202be4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71838f expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.583519:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135949.583522:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787135949.583525:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202be4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71838f expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.583532:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7c00, rc 0) 00000100:00100000:2.0:1787135949.583589:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10536:x1873947595428352:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 248us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.583596:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 112 00000040:00080000:1.0:1787135949.656619:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787135949.656628:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787135949.656665:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787135949.656671:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787135949.657281:0:11666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98769c0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1873947616413056:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787135949.659974:0:11666:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f78540 going to sleep for 11 seconds 00000100:00100000:1.0:1787135949.660012:0:11666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98769c0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1873947616413056:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787135949.661840:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.661900:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595428480 00000100:00100000:2.0:1787135949.661918:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595428480 00000100:00100000:2.0:1787135949.661978:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:2.0:1787135949.662002:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10537:x1873947595428480:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787135949.662031:0:5822:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787135949.662168:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10537:x1873947595428480:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 167us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.662177:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 113 00000100:00100000:3.0:1787135949.664452:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.664514:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595428608 00000100:00100000:2.0:1787135949.664523:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595428608 00000100:00100000:2.0:1787135949.664649:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:2.0:1787135949.664912:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10537:x1873947595428608:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787135949.664976:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202beb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.664992:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202beb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665004:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202beb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665089:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202bf2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665097:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665105:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665125:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202bf9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665148:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665155:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135949.665189:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787135949.665193:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135949.665206:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665218:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202beb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665226:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202beb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665233:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202beb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665239:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135949.665243:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202beb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665251:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202beb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665262:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9853809600) 00010000:00010000:2.0:1787135949.665265:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135949.665269:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202beb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665284:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202beb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665297:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202bf2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665304:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202bf2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665310:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665315:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135949.665317:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202bf2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665323:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202bf2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665329:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8e98532d1900) 00010000:00010000:2.0:1787135949.665332:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135949.665334:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202bf2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665339:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202bf2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665352:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665357:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202bf9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665389:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665394:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135949.665397:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665403:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202bf9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665411:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135949.665413:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135949.665416:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202bf9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.665421:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202bf9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.665490:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10537:x1873947595428608:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 Request processed in 582us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.665499:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:3.0:1787135949.668473:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.669452:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595428864 00000100:00100000:2.0:1787135949.669463:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595428864 00000100:00100000:2.0:1787135949.669526:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:2.0:1787135949.669536:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:10537:x1873947595428864:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787135949.669555:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135949.669575:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718396 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.669687:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.669700:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.669710:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135949.669721:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787135949.669812:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.669819:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.669825:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.669831:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135949.669835:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.669843:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.669863:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135949.669866:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787135949.669874:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.669894:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.669933:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c00 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718396 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.669943:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9853809600) 00010000:00010000:2.0:1787135949.669945:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787135949.669948:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718396 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.669962:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7800, rc 0) 00000100:00100000:2.0:1787135949.670542:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:10537:x1873947595428864:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 1004us (2075us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787135949.670550:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:1.0:1787135949.679009:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.683839:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595428992 00000100:00100000:3.0:1787135949.683854:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595428992 00000100:00100000:3.0:1787135949.683962:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:3.0:1787135949.683973:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:10537:x1873947595428992:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787135949.684035:0:7623:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787135949.684188:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:10537:x1873947595428992:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 217us (5187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135949.684196:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:0.0:1787135949.691400:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135949.691492:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595429248 00000100:00100000:1.0:1787135949.691501:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595429248 00000100:00100000:1.0:1787135949.691559:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:1.0:1787135949.691569:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:10537:x1873947595429248:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787135949.691589:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135949.691592:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787135949.691617:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202ba5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71837a expref: 56 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.691650:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:1.0:1787135949.691654:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787135949.691666:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202c15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71839d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787135949.692704:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787135949.692951:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202c1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.692966:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.692978:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.693030:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202c15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71839d expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.693302:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202c1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71839d expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.693314:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e98494a1400) 00010000:00010000:0.0:1787135949.693317:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787135949.693321:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897600, rc 0) 00000100:00100000:0.0:1787135949.693419:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:10537:x1873947595429248:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 1851us (2029us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1787135949.693441:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:1.0:1787135949.704554:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.704720:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595429504 00000100:00100000:2.0:1787135949.704731:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595429504 00000100:00100000:2.0:1787135949.704793:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:2.0:1787135949.704803:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:10537:x1873947595429504:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787135949.704853:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135949.704877:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202c1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71839d expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.704894:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e98494a1400) 00010000:00010000:2.0:1787135949.704905:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135949.704924:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.704948:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.704958:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.704974:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x45f2b349 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.704981:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x45f2b349 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.704988:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x45f2b349 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705364:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705381:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705388:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705393:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135949.705397:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705404:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705412:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:2.0:1787135949.705425:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135949.705429:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705434:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202c2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705443:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x45f2b349 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705448:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x45f2b349 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705454:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x45f2b349 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705459:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135949.705461:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x45f2b349 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705467:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x45f2b349 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705472:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x45f2b349 (ffff8e98532d1900) 00010000:00010000:2.0:1787135949.705474:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135949.705476:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x45f2b349 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.705481:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x45f2b349 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.705547:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:10537:x1873947595429504:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 745us (1001us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787135949.705559:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:1.0:1787135949.710618:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.711215:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595429632 00000100:00100000:3.0:1787135949.711225:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595429632 00000100:00100000:3.0:1787135949.711283:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:3.0:1787135949.711292:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:10537:x1873947595429632:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787135949.711311:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135949.711331:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202c38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183a4 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.711363:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202c3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.711386:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.711397:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.711497:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202c38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183a4 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.711518:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202c3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183a4 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.711527:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9843179e00) 00010000:00010000:3.0:1787135949.711536:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787135949.711540:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db600, rc 0) 00000100:00100000:3.0:1787135949.711600:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:10537:x1873947595429632:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 307us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135949.711610:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:0.0:1787135949.722148:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.722222:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595429888 00000100:00100000:2.0:1787135949.722230:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595429888 00000100:00100000:2.0:1787135949.722284:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 120 00000100:00100000:2.0:1787135949.722292:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:10537:x1873947595429888:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787135949.722359:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.722386:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.722396:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787135949.722663:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:2.0:1787135949.722739:0:5821:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000b7c594cc reply state 0000000019a3ce6a transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.722748:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787135949.722863:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:10537:x1873947595429888:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 571us (723us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1787135949.722868:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 120 00010000:00010000:1.0:1787135949.730829:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.730847:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.730856:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.730861:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135949.730870:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.730881:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.730896:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9843179e00) 00010000:00010000:1.0:1787135949.730899:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787135949.730904:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.730910:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135949.731697:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.733172:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595430016 00000100:00100000:3.0:1787135949.733184:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595430016 00000100:00100000:3.0:1787135949.733247:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:3.0:1787135949.733256:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:10537:x1873947595430016:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787135949.733277:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135949.733295:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202c4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183ab expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.733348:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ab expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.733362:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ab expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.733391:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9843179e00) 00010000:00010000:3.0:1787135949.733394:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135949.733397:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dbe00, rc 0) 00000100:00100000:3.0:1787135949.733968:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:10537:x1873947595430016:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 710us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135949.733977:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:3.0:1787135949.738373:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135949.738470:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595430144 00000100:00100000:1.0:1787135949.738479:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595430144 00000100:00100000:1.0:1787135949.738545:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:1.0:1787135949.738555:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2359:x1873947595430144:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787135949.738824:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2359:x1873947595430144:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 269us (468us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787135949.738830:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00080000:0.0:1787135949.739088:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787135949.742141:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.742260:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595430400 00000100:00100000:3.0:1787135949.742283:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595430400 00000100:00100000:3.0:1787135949.742337:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:3.0:1787135949.742347:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:10537:x1873947595430400:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787135949.742582:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:10537:x1873947595430400:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 236us (449us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1787135949.742590:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:2.0:1787135949.746865:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135949.746969:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595430656 00000100:00100000:0.0:1787135949.746980:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595430656 00000100:00100000:0.0:1787135949.747037:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:0.0:1787135949.747129:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:10537:x1873947595430656:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787135949.747453:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:10537:x1873947595430656:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 405us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135949.747462:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 122 00000100:00100000:1.0:1787135949.754760:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135949.754904:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595430784 00000100:00100000:0.0:1787135949.754914:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595430784 00000100:00100000:0.0:1787135949.754977:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:0.0:1787135949.754987:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:10537:x1873947595430784:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787135949.755007:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135949.755026:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202c54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183b2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.755127:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.755141:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.755152:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135949.755193:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787135949.755210:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.755235:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202c54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183b2 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.755254:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183b2 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.755263:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9843179e00) 00010000:00010000:0.0:1787135949.755266:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787135949.755269:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897000, rc 0) 00000100:00100000:0.0:1787135949.755329:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:10537:x1873947595430784:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 343us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135949.755336:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 123 00000100:00100000:2.0:1787135949.758113:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.761514:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595430912 00000100:00100000:3.0:1787135949.761529:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595430912 00000100:00100000:2.0:1787135949.761659:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:2.0:1787135949.761680:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2360:x1873947595430912:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787135949.761697:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135949.762209:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008193884/0xf5850c552f202c62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183b9 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787135949.762235:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8587cd, blocks: 0x1 00010000:00010000:2.0:1787135949.762252:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=309s v=(0 0) 00010000:00010000:2.0:1787135949.762256:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135949.762264:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008193884/0xf5850c552f202c62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183b9 expref: 10 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.762280:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008193884/0xf5850c552f202c62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183b9 expref: 10 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.762294:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6800, rc 0) 00000100:00100000:2.0:1787135949.762361:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:2360:x1873947595430912:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 683us (4256us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.762378:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:2.0:1787135949.765219:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.766547:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595431168 00000100:00100000:3.0:1787135949.766558:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595431168 00000100:00100000:3.0:1787135949.766627:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:3.0:1787135949.766637:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:10537:x1873947595431168:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787135949.766745:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874209f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:10537:x1873947595431168:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 110us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135949.766753:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 124 00000100:00100000:1.0:1787135949.769752:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.769830:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595431296 00000100:00100000:3.0:1787135949.769840:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595431296 00000100:00100000:3.0:1787135949.769890:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:3.0:1787135949.769900:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:10537:x1873947595431296:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787135949.769917:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135949.769935:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183c0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.769968:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008193884/0xf5850c552f202c62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183b9 expref: 11 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.769995:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787135949.769999:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787135949.770006:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c0 expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.770038:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008193884/0xf5850c552f202c62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183b9 expref: 11 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.770091:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008193884/0xf5850c552f202c62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183b9 expref: 11 pid: 6672 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135949.770107:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1873947616413184:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135949.770190:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98604570c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135949.772919:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.773040:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1873947616413184:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135949.773093:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c0 expref: 11 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.773112:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da200, rc 0) 00000100:00100000:3.0:1787135949.773167:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+11:10537:x1873947595431296:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 3270us (3424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135949.773175:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:2.0:1787135949.776996:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595431424 00000100:00100000:2.0:1787135949.777009:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595431424 00010000:00010000:2.0:1787135949.777205:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008193884/0xf5850c552f202c62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183b9 expref: 11 pid: 6672 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.777242:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:2.0:1787135949.777253:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+11:2360:x1873947595431424:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135949.777270:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135949.777291:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008193884/0xf5850c552f202c62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183b9 expref: 11 pid: 6672 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.777321:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008193884/0xf5850c552f202c62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183b9 expref: 11 pid: 6672 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.777345:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008193884/0xf5850c552f202c62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183b9 expref: 11 pid: 6672 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.777360:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135949.777365:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135949.777382:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c0 expref: 10 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.777393:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c0 expref: 10 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.777540:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c0 expref: 10 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.777555:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874208e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873947616413312:192.168.203.38@tcp:105: 00000100:00100000:2.0:1787135949.777637:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c4e0480 going to sleep for 11 seconds 00000100:00100000:2.0:1787135949.780673:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874208e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5808:1873947616413312:192.168.203.38@tcp:105: 00010000:00010000:2.0:1787135949.780699:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135949.780763:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:2360:x1873947595431424:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 3510us (7850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.780774:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:0.0:1787135949.786140:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.786339:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595431552 00000100:00100000:2.0:1787135949.786348:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595431552 00002000:00100000:2.0:1787135949.786404:0:6678:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e987485c700 x1873947595431552/t0(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:375/0 lens 504/0 e 0 to 0 dl 1787135960 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787135949.786427:0:6678:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e987485c700 with x1873947595431552 ext(0->12) 00002000:00010000:2.0:1787135949.786433:0:6678:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e987485c700 00000100:00100000:2.0:1787135949.786463:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1787135949.786472:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:2360:x1873947595431552:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787135949.786884:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+12:2360:x1873947595431552:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 Request processed in 411us (750us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787135949.786893:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00002000:00100000:2.0:1787135949.786901:0:6678:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e987485c700 x1873947595431552/t4294967308(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:375/0 lens 504/448 e 0 to 0 dl 1787135960 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787135949.786908:0:6678:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e987485c700 with x1873947595431552 ext(0->12) 00002000:00010000:2.0:1787135949.786911:0:6678:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e987485c700 00000100:00100000:1.0:1787135949.789607:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135949.789695:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595431680 00000100:00100000:0.0:1787135949.789705:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595431680 00000100:00100000:0.0:1787135949.789759:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 125 00000100:00100000:0.0:1787135949.789770:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:10537:x1873947595431680:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787135949.871188:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:10537:x1873947595431680:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 Request processed in 81409us (81578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135949.871206:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 125 00000001:00080000:3.0:1787135949.871310:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000001:00080000:3.0:1787135949.871337:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1787135949.871363:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787135949.871426:0:5844:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1787135949.871442:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787135949.871453:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787135949.871469:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e9846145c00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787135949.871474:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e9873ad7d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e9846145180 00000020:00080000:3.0:1787135949.871476:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e9873ad7500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e9881fd7800 00000020:00080000:3.0:1787135949.871556:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e987458c240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787135949.871560:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e9873ad7300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e987458ce40 00000020:00080000:3.0:1787135949.871563:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e9873ad7a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e9850b58400 00000100:00100000:3.0:1787135949.871686:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616413440:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787135949.871742:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135949.871811:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616413440 00000100:00100000:3.0:1787135949.871818:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616413440 00000100:00100000:3.0:1787135949.871858:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787135949.871866:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3303:x1873947616413440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787135949.871891:0:6672:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1787135949.871919:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8587cc, atime: 0x6a8587cd, ctime: 0x6a8587cc, blocks: 0x1 00010000:00010000:3.0:1787135949.871927:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbfd813/0xf5850c552f202c70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.871941:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=309s v=(0 0) 00010000:00010000:3.0:1787135949.871946:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787135949.871951:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002dbfd813/0xf5850c552f202c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.871965:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002dbfd813/0xf5850c552f202c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1787135949.872121:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787135949.872300:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1787135949.872498:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002dbfd813/0xf5850c552f202c70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.872505:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002dbfd813/0xf5850c552f202c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135949.873274:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.873312:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787135949.873319:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1787135949.873350:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616413568:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787135949.873397:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135949.873445:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787135949.873452:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595431808 00000100:00100000:0.0:1787135949.873457:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595431808 00000100:00100000:0.0:1787135949.873484:0:6674:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1787135949.873490:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616413568 00000100:00100000:0.0:1787135949.873492:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616413568 00000100:00080000:1.0:1787135949.873857:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787135949.874090:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787135949.874813:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3303:x1873947616413440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2943us (3067us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787135949.874822:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787135949.874847:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:2.0:1787135949.874864:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+12:2359:x1873947595431808:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1787135949.886106:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e9881fc1500/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787135949.886122:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616413440:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787135949.888354:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787135949.888380:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3300:x1873947616413568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787135949.888421:0:11994:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1787135949.888445:0:11994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.888467:0:11994:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007543cd90/0xf5850c552f202a32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71831f expref: 12 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.888475:0:11994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787135949.888479:0:11994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787135949.888484:0:11994:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.888518:0:11994:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007543cd90/0xf5850c552f202a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71831f expref: 12 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.888544:0:11994:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007543cd90/0xf5850c552f202a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71831f expref: 12 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135949.888558:0:11994:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874496680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11994:1873947616413696:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135949.888951:0:11994:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987458c0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1787135949.889506:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787135949.889514:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002dbfd813/0xf5850c552f202c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.889524:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787135949.889528:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbfd813/0xf5850c552f202c70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.889538:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002dbfd813/0xf5850c552f202c70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.889556:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002dbfd813/0xf5850c552f202c70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.889577:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002dbfd813/0xf5850c552f202c70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135949.889604:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135949.889606:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135949.889608:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135949.896097:0:11994:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874496680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11994:1873947616413696:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135949.896098:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1787135949.896123:0:11994:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135949.899204:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595431936 00000100:00100000:0.0:1787135949.899219:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595431936 00010000:00010000:0.0:1787135949.899258:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007543cd90/0xf5850c552f202a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71831f expref: 13 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135949.899342:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1787135949.899353:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2359:x1873947595431936:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135949.899376:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135949.899382:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007543cd90/0xf5850c552f202a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71831f expref: 13 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.899396:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007543cd90/0xf5850c552f202a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71831f expref: 13 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.899425:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007543cd90/0xf5850c552f202a32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71831f expref: 13 pid: 6674 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.899441:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787135949.899445:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787135949.899451:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.899475:0:7612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.899510:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135949.899561:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874208e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+12:2359:x1873947595431936:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 210us (3468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135949.899569:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00010000:00010000:3.0:1787135949.899815:0:11994:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.899826:0:11994:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.899836:0:11994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.899844:0:11994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.899860:0:11994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787135949.899873:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787135949.899879:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.899893:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db800 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787135949.899897:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.899907:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.899918:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.899926:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056ad2d71/0xf5850c552f202c77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.899942:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135949.899944:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135949.899946:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135949.903196:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3300:x1873947616413568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14825us (29792us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787135949.903209:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:3.0:1787135949.903218:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e987c2f5180/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787135949.903243:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616413568:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1787135949.914020:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135949.985454:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+11:2359:x1873947595431808:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 Request processed in 110583us (112173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135949.985468:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000001:00080000:3.0:1787135949.985503:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1787135949.985511:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1787135949.985519:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1787135949.987757:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135949.987977:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595432192 00000100:00100000:3.0:1787135949.987999:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595432192 00000100:00100000:3.0:1787135949.988085:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:3.0:1787135949.988095:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:10537:x1873947595432192:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787135949.988141:0:7623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135949.988171:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202c5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183b2 expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.988189:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9843179e00) 00010000:00010000:3.0:1787135949.988193:0:7623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787135949.988272:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202c7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.988288:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135949.988298:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787135949.988918:0:7623:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000172a005d reply state 00000000857379f6 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135949.988932:0:7623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787135949.989032:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874209c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:10537:x1873947595432192:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 937us (1280us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787135949.989041:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 126 00000100:00100000:2.0:1787135949.992887:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:3.0:1787135949.993344:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202c7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.993358:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202c7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.993373:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202c7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.993380:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135949.993385:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202c7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.993392:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202c7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.993408:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9843179e00) 00010000:00010000:3.0:1787135949.993411:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135949.993416:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202c7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135949.993422:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202c7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135949.993590:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595432320 00000100:00100000:1.0:1787135949.993602:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595432320 00000100:00100000:1.0:1787135949.993659:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:1.0:1787135949.993670:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595432320:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787135949.993885:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787135949.993889:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787135949 00002000:00010000:1.0:1787135949.993891:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787135949 00002000:00010000:1.0:1787135949.993893:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787135949 -> 1787135949 00002000:00010000:1.0:1787135949.993896:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787135949.994175:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595432320:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 506us (1294us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787135949.994184:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:3.0:1787135949.996295:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135949.996362:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595432576 00000100:00100000:2.0:1787135949.996383:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595432576 00000100:00100000:2.0:1787135949.996455:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:2.0:1787135949.996466:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:10537:x1873947595432576:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787135949.996530:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.996548:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202c3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183a4 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.996558:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.996591:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202c3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183a4 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135949.996606:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202c3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183a4 expref: 15 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135949.996621:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616413824:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135949.996742:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98741070c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135950.000788:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135950.001484:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616413824:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135950.001517:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135950.001666:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595432704 00000100:00100000:0.0:1787135950.001682:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595432704 00010000:00010000:0.0:1787135950.001734:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202c3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183a4 expref: 16 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135950.001890:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:0.0:1787135950.001901:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874208a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:2359:x1873947595432704:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135950.001915:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135950.001924:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202c3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183a4 expref: 16 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.001936:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202c3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183a4 expref: 16 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.001958:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db600/0xf5850c552f202c3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183a4 expref: 16 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.001972:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9843179e00) 00010000:00010000:0.0:1787135950.001977:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.001986:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.001993:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.002017:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787135950.002237:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.002245:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.002275:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.002282:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.002289:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.002295:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135950.002299:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.002306:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.002315:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9843179e00) 00010000:00010000:3.0:1787135950.002317:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787135950.002321:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.002336:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202c85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135950.002488:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874208a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:2359:x1873947595432704:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 587us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135950.002496:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:3.0:1787135950.002665:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:10537:x1873947595432576:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 Request processed in 6202us (6379us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787135950.002682:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 127 00000100:00100000:2.0:1787135950.005359:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135950.005450:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595432832 00000100:00100000:0.0:1787135950.005472:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595432832 00000100:00100000:0.0:1787135950.005553:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:0.0:1787135950.005563:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595432832:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787135950.005607:0:11994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.005627:0:11994:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c0 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.005635:0:11994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135950.005639:0:11994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787135950.005644:0:11994:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.005684:0:11994:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c0 expref: 7 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.005699:0:11994:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c0 expref: 7 pid: 6673 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135950.005722:0:11994:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11994:1873947616413952:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135950.005919:0:11994:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98432fc780 going to sleep for 11 seconds 00000100:00100000:2.0:1787135950.009458:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135950.009932:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595432960 00000100:00100000:3.0:1787135950.009941:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595432960 00010000:00010000:3.0:1787135950.009977:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c0 expref: 8 pid: 6673 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135950.010019:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:3.0:1787135950.010027:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595432960:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787135950.010040:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135950.010180:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c0 expref: 8 pid: 6673 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.010194:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c0 expref: 8 pid: 6673 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.010219:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787135950.010223:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787135950.010229:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.010239:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.010271:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135950.010325:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595432960:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 298us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135950.010332:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00010000:00010000:0.0:1787135950.012990:0:11994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f6b3e7d/0xf5850c552f202c69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c0 expref: 7 pid: 6673 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135950.013013:0:11994:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11994:1873947616413952:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787135950.013333:0:11994:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.013346:0:11994:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.013354:0:11994:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.013396:0:11994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.013405:0:11994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.013414:0:11994:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.013422:0:11994:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896e00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787135950.013426:0:11994:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.013434:0:11994:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.013451:0:11994:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.013465:0:11994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3401272/0xf5850c552f202c8c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135950.013604:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874209880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595432832:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 Request processed in 8041us (8252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135950.013614:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:2.0:1787135950.016772:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135950.016855:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595433216 00000100:00100000:3.0:1787135950.016865:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595433216 00000100:00100000:3.0:1787135950.016948:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:3.0:1787135950.016959:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:10537:x1873947595433216:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787135950.017030:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202c93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.017085:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202c93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.017097:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202c93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.017291:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.017303:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202c4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ab expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.017311:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.017341:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202c4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ab expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.017383:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202c4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ab expref: 15 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135950.017397:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874496300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616414080:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135950.017470:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aefd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787135950.020225:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135950.020302:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595433344 00000100:00100000:2.0:1787135950.020310:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595433344 00010000:00010000:2.0:1787135950.020346:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202c4d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ab expref: 16 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135950.020397:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:2.0:1787135950.020406:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:2360:x1873947595433344:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135950.020419:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135950.020427:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202c4d lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ab expref: 16 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.020440:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202c4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ab expref: 16 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.020459:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9843179e00) 00010000:00010000:2.0:1787135950.020464:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.020473:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.020479:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.020512:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135950.020561:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+16:2360:x1873947595433344:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 156us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135950.020569:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00010000:00010000:3.0:1787135950.021490:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dbe00/0xf5850c552f202c4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ab expref: 15 pid: 5822 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135950.021507:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874496300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616414080:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135950.021527:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.021536:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.021542:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787135950.021819:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787135950.021946:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787135950.021987:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1787135950.022104:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9874496300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5821:1873947616414208:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787135950.022154:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135950.022175:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aef840 going to sleep for 11 seconds 00000100:00100000:1.0:1787135950.022233:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616414208 00000100:00100000:1.0:1787135950.022240:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616414208 00000100:00100000:1.0:1787135950.022282:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787135950.022291:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5821:x1873947616414208:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787135950.022360:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5821:x1873947616414208:12345-0@lo:1000:mdt00_000.0 Request processed in 71us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135950.022391:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787135950.022422:0:5821:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1787135950.022428:0:5821:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1787135950.022445:0:5821:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8e987c2f5180 x1873947616413568/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787135965 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135950.022456:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9874496300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5821:1873947616414208:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787135950.023634:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1787135950.023852:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5821:1873947616414336:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787135950.023898:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135950.023929:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f789c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135950.023990:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616414336 00000100:00100000:3.0:1787135950.023996:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616414336 00000100:00100000:1.0:1787135950.024183:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787135950.024192:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5821:x1873947616414336:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787135950.024417:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5821:x1873947616414336:12345-0@lo:1000:mdt00_000.0 Request processed in 226us (517us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787135950.024425:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787135950.024559:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5821:1873947616414336:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787135950.024591:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.024601:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.024608:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.024614:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840030200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135950.024618:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.024626:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.024641:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9843179e00) 00010000:00010000:2.0:1787135950.024644:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787135950.024648:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.024654:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202c9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.024953:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202bdd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.024967:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202bdd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.024972:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202bdd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.024977:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135950.024980:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202bdd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.024985:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202bdd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.024993:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135950.024996:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787135950.025003:0:5821:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202be4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71838f expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.025014:0:5821:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202be4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71838f expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.025024:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202be4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71838f expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.025277:0:5821:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202be4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71838f expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135950.025291:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616414464:192.168.203.38@tcp:105: 00000100:00100000:2.0:1787135950.025377:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874107840 going to sleep for 11 seconds 00000100:00100000:1.0:1787135950.027862:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135950.027922:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595433472 00000100:00100000:3.0:1787135950.027940:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595433472 00000100:00100000:3.0:1787135950.027991:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:3.0:1787135950.028000:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:10536:x1873947595433472:12345-192.168.203.38@tcp:49:lfs.0 00000100:00100000:3.0:1787135950.028151:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:10536:x1873947595433472:12345-192.168.203.38@tcp:49:lfs.0 Request processed in 152us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135950.028159:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:2.0:1787135950.029746:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616414464:192.168.203.38@tcp:105: 00010000:00010000:2.0:1787135950.029777:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202bdd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029787:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202bdd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029822:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ca1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029835:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ca1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029845:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ca1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029855:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ca1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029861:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ca1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029868:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ca1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029874:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135950.029878:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ca1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029885:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ca1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029912:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135950.029915:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135950.029919:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ca1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029926:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ca1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029935:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202c93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029940:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202c93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029946:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202c93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029950:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840030a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135950.029954:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202c93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029959:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202c93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029967:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135950.029969:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787135950.029972:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202c93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135950.029978:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202c93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135950.030443:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874208380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:10537:x1873947595433216:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 13484us (13778us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787135950.030453:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 128 00000020:00080000:2.0:1787135950.030458:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1787135950.031040:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787135950.031078:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787135950.031107:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787135950.031113:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787135950.032638:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135950.032725:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595433728 00000100:00100000:3.0:1787135950.032734:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595433728 00000100:00100000:3.0:1787135950.032786:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:3.0:1787135950.032795:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:10536:x1873947595433728:12345-192.168.203.38@tcp:58:lfs.0 00000040:00080000:3.0:1787135950.033138:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1787135950.033383:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:10536:x1873947595433728:12345-192.168.203.38@tcp:58:lfs.0 Request processed in 587us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135950.033391:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:0.0:1787135950.037533:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135950.037586:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595433984 00000100:00100000:3.0:1787135950.037595:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595433984 00000100:00100000:3.0:1787135950.037648:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:3.0:1787135950.037658:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9860737450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:10537:x1873947595433984:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787135950.038255:0:5824:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787135950.038343:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1787135950.038399:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ca8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.038415:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.038426:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.038445:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ca8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.038451:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ca8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.038457:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ca8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135950.038478:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787135950.038514:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787135950.038523:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ca8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.038531:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840031800 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787135950.038536:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ca8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.038544:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ca8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.038559:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e9843179000) 00010000:00010000:0.0:1787135950.038561:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787135950.038566:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ca8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.038577:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ca8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.038595:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135950.038598:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135950.038605:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135950.038616:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9860737450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:10537:x1873947595433984:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 957us (1090us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1787135950.038624:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000020:00080000:3.0:1787135950.038629:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787135950.058256:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135950.058400:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595434112 00000100:00100000:0.0:1787135950.058411:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595434112 00000100:00100000:0.0:1787135950.058471:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:0.0:1787135950.058482:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:10539:x1873947595434112:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1787135950.058507:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135950.058526:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202caf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183c7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.058581:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202cb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.058591:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202cb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.058600:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202cb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.058611:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202cbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.058616:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.058620:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.059260:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202cc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.059274:0:7623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718388 expref: 21 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.059295:0:7623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202cc4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.059329:0:7623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718388 expref: 21 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.059344:0:7623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718388 expref: 21 pid: 7623 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135950.059359:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616414592:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787135950.059815:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98432fc780 going to sleep for 11 seconds 00000100:00100000:0.0:1787135950.062840:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616414592:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787135950.062874:0:7623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202cc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135950.064919:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135950.065689:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595434368 00000100:00100000:0.0:1787135950.065700:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595434368 00000100:00100000:0.0:1787135950.065907:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:0.0:1787135950.065918:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:5597:x1873947595434368:12345-192.168.203.38@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787135950.066196:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:5597:x1873947595434368:12345-192.168.203.38@tcp:35:ldlm_bl.0 Request processed in 279us (1284us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1787135950.066204:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:1.0:1787135950.069531:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135950.069826:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595434496 00000100:00100000:0.0:1787135950.069835:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595434496 00010000:00010000:0.0:1787135950.069875:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718388 expref: 23 pid: 7623 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135950.069933:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1787135950.069945:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:2360:x1873947595434496:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135950.069963:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135950.069971:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718388 expref: 23 pid: 7623 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.069983:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718388 expref: 23 pid: 7623 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.070006:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511dac00/0xf5850c552f202bcf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718388 expref: 23 pid: 7623 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.070023:0:7612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:0.0:1787135950.070028:0:7612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202cc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.070038:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.070094:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202cc4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135950.070114:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135950.070161:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:2360:x1873947595434496:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 220us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135950.070166:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00010000:00010000:1.0:1787135950.070252:0:7623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070267:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135950.070305:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787135950.070309:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787135950.070324:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070333:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070339:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202cb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070344:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202cb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070348:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070352:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135950.070355:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202cb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070360:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202cb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070379:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:1.0:1787135950.070381:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135950.070384:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202cb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070395:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202cb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070468:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202cbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070477:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202cbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070481:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202cbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070484:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135950.070486:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202cbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070490:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202cbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070496:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e98494a1400) 00010000:00010000:1.0:1787135950.070497:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135950.070499:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202cbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070503:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202cbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070530:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202caf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c7 expref: 22 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070542:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c7 expref: 21 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135950.070556:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:1.0:1787135950.070558:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787135950.070561:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897c00, rc 0) 00000100:00100000:1.0:1787135950.070600:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:10539:x1873947595434112:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 12121us (12354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135950.070608:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 130 00000100:00100000:1.0:1787135950.693343:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135950.693397:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135950.693426:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135950.693461:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135950.693483:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135950.693509:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595435136 00000100:00100000:1.0:1787135950.693517:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595435136 00000100:00100000:1.0:1787135950.693585:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595434752 00000100:00100000:1.0:1787135950.693588:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595434752 00000100:00100000:1.0:1787135950.693610:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:1.0:1787135950.693620:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2362:x1873947595435136:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135950.693691:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2362:x1873947595435136:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135950.693699:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 128 00000100:00100000:1.0:1787135950.693951:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:1.0:1787135950.693958:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:2362:x1873947595434752:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135950.693990:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:2362:x1873947595434752:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 32us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135950.694006:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 129 00000100:00100000:1.0:1787135950.694030:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595434880 00000100:00100000:1.0:1787135950.694034:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595434880 00000100:00100000:1.0:1787135950.694090:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595435008 00000100:00100000:1.0:1787135950.694093:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595435008 00000100:00100000:1.0:1787135950.694114:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:1.0:1787135950.694121:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2362:x1873947595434880:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135950.694150:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2362:x1873947595434880:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135950.694156:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:1.0:1787135950.694168:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:1.0:1787135950.694175:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2362:x1873947595435008:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135950.694200:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2362:x1873947595435008:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135950.694206:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00080000:1.0:1787135950.694222:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787135950.694226:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135950.694402:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595434624 00000100:00100000:3.0:1787135950.694407:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595434624 00000100:00100000:3.0:1787135950.694446:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 284 00000100:00100000:3.0:1787135950.694454:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:2362:x1873947595434624:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135950.694492:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:2362:x1873947595434624:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 38us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135950.694498:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 284 00000040:00080000:1.0:1787135950.880612:0:12034:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787135950.880622:0:12034:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787135950.884603:0:12034:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787135950.884612:0:12034:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787135950.937531:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787135950.942439:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1787135950.942459:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:0.0:1787135950.942466:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1787135950.942474:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000040:00080000:1.0:1787135951.065280:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787135951.065289:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787135951.065324:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787135951.065331:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787135951.065460:0:11666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1873947616414720:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787135951.065568:0:11666:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f78600 going to sleep for 11 seconds 00000100:00100000:2.0:1787135951.068601:0:11666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420f100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1873947616414720:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787135951.071085:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135951.071160:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595435264 00000100:00100000:1.0:1787135951.071170:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595435264 00000100:00100000:1.0:1787135951.071236:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00100000:1.0:1787135951.071246:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:10551:x1873947595435264:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787135951.071275:0:5822:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787135951.071381:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:10551:x1873947595435264:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 136us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135951.071390:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 131 00000100:00080000:2.0:1787135951.071503:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135951.080403:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135951.080476:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595435520 00000100:00100000:2.0:1787135951.080485:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595435520 00000100:00100000:2.0:1787135951.080542:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:2.0:1787135951.080552:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:10551:x1873947595435520:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787135951.080574:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135951.080593:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202ccb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183ce expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135951.080686:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202cd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135951.080701:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135951.080714:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135951.080725:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787135951.080844:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202ccb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ce expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135951.080871:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ce expref: 23 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135951.080880:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135951.080883:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787135951.080886:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6800, rc 0) 00000100:00100000:2.0:1787135951.080946:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:10551:x1873947595435520:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 396us (552us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787135951.080953:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 132 00000100:00100000:1.0:1787135951.098029:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135951.098094:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135951.098121:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595435776 00000100:00100000:1.0:1787135951.098130:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595435776 00000100:00100000:1.0:1787135951.098178:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:1.0:1787135951.098188:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:10551:x1873947595435776:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787135951.098256:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f202ce0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135951.098272:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f202ce0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135951.098282:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f202ce0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135951.098465:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f202ce0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135951.098471:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f202ce0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135951.098486:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f202ce0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135951.098492:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afe00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135951.098497:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f202ce0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135951.098504:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f202ce0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135951.098518:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:1.0:1787135951.098521:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787135951.098526:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f202ce0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135951.098532:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f202ce0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135951.098668:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:10551:x1873947595435776:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 480us (643us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787135951.098676:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:1.0:1787135951.098703:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595435904 00000100:00100000:1.0:1787135951.098708:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595435904 00000100:00100000:1.0:1787135951.098739:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:1.0:1787135951.098746:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:2360:x1873947595435904:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787135951.098758:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135951.098772:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202cd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ce expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135951.098796:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:1.0:1787135951.098800:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135951.098819:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:2360:x1873947595435904:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 73us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135951.098826:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000040:00080000:1.0:1787135951.098922:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787135951.098927:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787135951.099453:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787135951.099461:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787135951.110351:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135951.110401:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595436160 00000100:00100000:1.0:1787135951.110410:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595436160 00000100:00100000:1.0:1787135951.110454:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:1.0:1787135951.110462:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:10551:x1873947595436160:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787135951.110680:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:10551:x1873947595436160:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 217us (334us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1787135951.110688:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:1.0:1787135951.833602:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616414848:0@lo:400:kworker.0 00000100:00100000:1.0:1787135951.833682:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135951.833760:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616414848 00000100:00100000:1.0:1787135951.833774:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616414848 00000100:00100000:1.0:1787135951.833829:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787135951.833837:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616414848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135951.833892:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616414848:12345-0@lo:400:kworker.0 Request processed in 55us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135951.833912:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787135951.833960:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616415104:0@lo:400:kworker.0 00000100:00100000:3.0:1787135951.833993:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616414848:0@lo:400:kworker.0 00000100:00100000:2.0:1787135951.834027:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616414976:0@lo:400:kworker.0 00000100:00100000:0.0:1787135951.834151:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616415360:0@lo:400:kworker.0 00000100:00100000:3.0:1787135951.834154:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616415232:0@lo:400:kworker.0 00000100:00100000:1.0:1787135951.847183:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135951.847195:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135951.847331:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135951.847410:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616415488:0@lo:400:kworker.0 00000100:00100000:2.0:1787135951.847443:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135951.847498:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616415232 00000100:00100000:2.0:1787135951.847505:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616415232 00000100:00100000:0.0:1787135951.847547:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135951.847557:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616415488 00000100:00100000:2.0:1787135951.847560:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616415488 00000100:00100000:2.0:1787135951.847582:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787135951.847590:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616415232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135951.847644:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616415232:12345-0@lo:400:kworker.0 Request processed in 54us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135951.847651:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787135951.847666:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787135951.847673:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1873947616415488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135951.847705:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874208a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3302:x1873947616415488:12345-0@lo:400:kworker.0 Request processed in 33us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135951.847723:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787135951.848479:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787135951.848484:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787135951.848506:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787135951.848513:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:0.0:1787135951.848530:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e98769c0a80, transno 4294967301 00000004:00080000:0.0:1787135951.848541:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1787135951.848550:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e9881fc1500, transno 4294967304 00000100:00100000:0.0:1787135951.848558:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616415232:0@lo:400:kworker.0 00000100:00100000:3.0:1787135951.848600:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616415104 00000100:00100000:3.0:1787135951.848605:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616415104 00000100:00100000:3.0:1787135951.848648:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616414976 00000100:00100000:3.0:1787135951.848652:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616414976 00000100:00100000:3.0:1787135951.848662:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616415360 00000100:00100000:3.0:1787135951.848664:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616415360 00000100:00100000:3.0:1787135951.848677:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787135951.848684:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616415104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135951.848726:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616415104:12345-0@lo:400:kworker.0 Request processed in 43us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135951.848732:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787135951.848744:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787135951.848749:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616414976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135951.848775:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874208e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616414976:12345-0@lo:400:kworker.0 Request processed in 25us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135951.848781:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787135951.848792:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787135951.848798:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616415360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135951.848829:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616415360:12345-0@lo:400:kworker.0 Request processed in 32us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135951.848835:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1787135951.848848:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135951.848904:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616415360:0@lo:400:kworker.0 00000100:00100000:0.0:1787135951.848942:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616415104:0@lo:400:kworker.0 00000100:00100000:0.0:1787135951.848971:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616415488:0@lo:400:kworker.0 00000100:00100000:0.0:1787135951.848980:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616414976:0@lo:400:kworker.0 00010000:00010000:1.0:1787135951.960297:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787135952.354473:0:8042:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 312297422285ns, next at 313297420127ns, rc = 0 00000100:00100000:0.0:1787135952.356267:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616415616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135952.356358:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135952.356672:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616415744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787135952.356892:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135952.356935:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616415616 00000100:00100000:0.0:1787135952.356943:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616415616 00000100:00100000:0.0:1787135952.356993:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616415744 00000100:00100000:0.0:1787135952.356997:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616415744 00000100:00100000:0.0:1787135952.357025:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787135952.357034:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1873947616415616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787135952.357122:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135952.357171:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1873947616415616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135952.357179:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787135952.357199:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787135952.357206:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616415744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787135952.357223:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135952.357251:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616415744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 46us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135952.357257:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787135952.357301:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616415744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787135952.357342:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616415616:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1787135952.727869:0:12086:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787135952.727878:0:12086:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787135952.727937:0:12086:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787135952.727943:0:12086:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787135952.975443:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135952.975542:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595436416 00000100:00100000:3.0:1787135952.975552:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595436416 00000100:00100000:3.0:1787135952.975622:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:3.0:1787135952.975633:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:10571:x1873947595436416:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135952.975792:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135952.975814:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ce7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183d5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135952.975979:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202cee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135952.975994:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202cee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135952.976007:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202cee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135952.976019:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787135952.977139:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202ce7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183d5 expref: 27 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135952.977165:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202cee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183d5 expref: 26 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135952.977175:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135952.977178:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787135952.977182:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9840030a00, rc 0) 00000100:00100000:2.0:1787135952.977261:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+26:10571:x1873947595436416:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1626us (1824us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1787135952.977269:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 134 00010000:00010000:2.0:1787135952.985078:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135952.985995:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135952.986081:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595436544 00000100:00100000:2.0:1787135952.986090:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595436544 00000100:00100000:2.0:1787135952.986148:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:2.0:1787135952.986159:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+26:10571:x1873947595436544:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:2.0:1787135952.986224:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202cfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135952.986242:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202cfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135952.986253:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202cfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135952.986280:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202cfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135952.986300:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202cfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135952.986307:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202cfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135952.986313:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135952.986318:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202cfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135952.986325:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202cfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135952.986337:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:2.0:1787135952.986340:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787135952.986354:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202cfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135952.986361:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f202cfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135952.986433:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+26:10571:x1873947595436544:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 276us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135952.986441:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 135 00000100:00100000:1.0:1787135953.158081:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135953.159233:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595436672 00000100:00100000:2.0:1787135953.159246:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595436672 00000100:00100000:2.0:1787135953.159339:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:2.0:1787135953.159365:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595436672:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:2.0:1787135953.159384:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135953.159429:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f780e215/0xf5850c552f202d03 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183dc expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787135953.159458:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8587cd, atime: 0x6a8587cd, ctime: 0x6a8587cd, blocks: 0xb 00010000:00010000:2.0:1787135953.159478:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=313s v=(0 0) 00010000:00010000:2.0:1787135953.159483:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135953.159491:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f780e215/0xf5850c552f202d03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183dc expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135953.159509:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f780e215/0xf5850c552f202d03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183dc expref: 7 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135953.159522:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6200, rc 0) 00000100:00100000:2.0:1787135953.159583:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2361:x1873947595436672:12345-192.168.203.38@tcp:101:cat.0 Request processed in 222us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135953.159591:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00080000:3.0:1787135953.159912:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787135953.163736:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135953.163926:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595436800 00000100:00100000:0.0:1787135953.163936:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595436800 00002000:00100000:0.0:1787135953.163985:0:6680:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8e9874598000 x1873947595436800/t0(0) o3->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:379/0 lens 488/0 e 0 to 0 dl 1787135964 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787135953.163996:0:6680:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e9874598000 with x1873947595436800 ext(0->4095) 00002000:00010000:0.0:1787135953.164002:0:6680:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e9874598000 00000100:00100000:0.0:1787135953.164042:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:0.0:1787135953.164089:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2362:x1873947595436800:12345-192.168.203.38@tcp:3:cat.0 00000100:00100000:0.0:1787135953.164313:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874598000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2362:x1873947595436800:12345-192.168.203.38@tcp:3:cat.0 Request processed in 227us (587us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787135953.164334:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00002000:00100000:0.0:1787135953.164351:0:6680:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8e9874598000 x1873947595436800/t0(0) o3->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:379/0 lens 488/4536 e 0 to 0 dl 1787135964 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787135953.164359:0:6680:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e9874598000 with x1873947595436800 ext(0->4095) 00002000:00010000:0.0:1787135953.164362:0:6680:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e9874598000 00010000:00010000:1.0:1787135954.009207:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787135955.000984:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1787135955.000999:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1787135955.006695:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000004:00080000:3.0:1787135955.006718:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:3.0:1787135955.006732:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1787135955.006747:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e9881f786c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787135955.006753:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e9843051600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e9881f78540 00000020:00080000:3.0:1787135955.006756:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e9843051100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e98503c4c00 00000020:00080000:3.0:1787135955.006775:0:5844:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:3.0:1787135955.006784:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787135955.006881:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1787135955.007107:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1787135955.007266:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616415872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787135955.007356:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135955.007803:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616415872 00000100:00100000:3.0:1787135955.007816:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616415872 00000100:00100000:3.0:1787135955.007907:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787135955.007919:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987459b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616415872:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1787135955.008234:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1787135955.008289:0:11994:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787135955.008294:0:11994:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787135949 -> 1787135949 00002000:00010000:3.0:1787135955.008306:0:11994:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1787135949 -> 1787135949 00002000:00010000:3.0:1787135955.008309:0:11994:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787135949 -> 1787135949 00002000:00010000:3.0:1787135955.008312:0:11994:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787135955.008409:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987459b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616415872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 492us (1052us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1787135955.008418:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787135955.008863:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1787135955.008872:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e987c2f5180, transno 4294967309 00000004:00080000:2.0:1787135955.008890:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1787135955.008915:0:3301:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8e987420bb80 x1873947616415872/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787135971 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787135955.008926:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e987420bb80/2, rc 0, transno 4294967312 00000100:00100000:2.0:1787135955.008932:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616415872:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1787135955.032395:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135955.822891:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135955.822980:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135955.823011:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135955.823077:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135955.823108:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135955.823135:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595437440 00000100:00100000:3.0:1787135955.823145:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595437440 00000100:00100000:3.0:1787135955.823200:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595437056 00000100:00100000:3.0:1787135955.823203:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595437056 00000100:00100000:3.0:1787135955.823226:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:3.0:1787135955.823235:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2361:x1873947595437440:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135955.823332:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2361:x1873947595437440:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 89us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135955.823340:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 133 00000100:00100000:3.0:1787135955.823356:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:3.0:1787135955.823363:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2361:x1873947595437056:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135955.823389:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2361:x1873947595437056:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135955.823395:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 134 00000100:00100000:3.0:1787135955.823413:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595437184 00000100:00100000:3.0:1787135955.823439:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595437184 00000100:00100000:3.0:1787135955.823465:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595437312 00000100:00100000:3.0:1787135955.823468:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595437312 00000100:00100000:3.0:1787135955.823490:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:3.0:1787135955.823496:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2361:x1873947595437184:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135955.823531:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874496300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2361:x1873947595437184:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135955.823547:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:3.0:1787135955.823558:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:3.0:1787135955.823564:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595437312:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135955.823588:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595437312:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135955.823594:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00080000:3.0:1787135955.823609:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787135955.823613:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787135955.823615:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135955.830776:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595436928 00000100:00100000:1.0:1787135955.830793:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595436928 00000100:00100000:1.0:1787135955.830911:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 286 00000100:00100000:1.0:1787135955.830922:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2361:x1873947595436928:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135955.831004:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2361:x1873947595436928:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 84us (8122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135955.831013:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 286 00010000:00010000:1.0:1787135956.057907:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135956.952373:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616416256:0@lo:400:kworker.0 00000100:00100000:0.0:1787135956.952445:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135956.952518:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787135956.952525:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616416384:0@lo:400:kworker.0 00000100:00100000:0.0:1787135956.952553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135956.952768:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616416128:0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.952800:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135956.952828:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616416640:0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.952850:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135956.952884:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787135956.952890:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616416000:0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.952918:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135956.952941:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616416512:0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.952963:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135956.952990:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616416256 00000100:00100000:3.0:1787135956.953010:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616416256 00000100:00100000:3.0:1787135956.953076:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616416128 00000100:00100000:3.0:1787135956.953080:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616416128 00000100:00100000:3.0:1787135956.953093:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616416512 00000100:00100000:3.0:1787135956.953095:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616416512 00000100:00100000:3.0:1787135956.953110:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787135956.953118:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616416256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.953171:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616416256:12345-0@lo:400:kworker.0 Request processed in 53us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135956.953178:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787135956.953196:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787135956.953201:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616416128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.953234:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616416128:12345-0@lo:400:kworker.0 Request processed in 33us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135956.953239:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787135956.953249:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787135956.953254:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616416512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.953278:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616416512:12345-0@lo:400:kworker.0 Request processed in 25us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135956.953283:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787135956.953300:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616416384 00000100:00100000:3.0:1787135956.953304:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616416384 00000100:00100000:3.0:1787135956.953339:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616416640 00000100:00100000:3.0:1787135956.953342:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616416640 00000100:00100000:3.0:1787135956.953487:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787135956.953503:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616416384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.953537:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616416384:12345-0@lo:400:kworker.0 Request processed in 43us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135956.953553:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787135956.953565:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787135956.953571:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1873947616416640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.953599:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1873947616416640:12345-0@lo:400:kworker.0 Request processed in 28us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135956.953605:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787135956.953626:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616416000 00000100:00100000:3.0:1787135956.953629:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616416000 00000100:00100000:3.0:1787135956.953651:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1787135956.953656:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616416000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.953684:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616416000:12345-0@lo:400:kworker.0 Request processed in 27us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135956.953689:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:3.0:1787135956.953715:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787135956.953720:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135956.953750:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616416000:0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.953762:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842bf0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616416512:0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.953772:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876cad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616416128:0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.953781:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842bf0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616416640:0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.953813:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616416384:0@lo:400:kworker.0 00000100:00100000:3.0:1787135956.953822:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876caf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616416256:0@lo:400:kworker.0 00010000:00010000:0.0:1787135957.080354:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135957.465178:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787135957.465200:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616416768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135957.465284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135957.465357:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616416768 00000100:00100000:0.0:1787135957.465364:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616416768 00000100:00100000:0.0:1787135957.465410:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787135957.465420:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616416768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787135957.465452:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135957.465493:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616416768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135957.465499:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787135957.465541:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616416768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787135957.465861:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787135957.465872:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987485fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616416896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787135957.465908:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787135957.465942:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787135957.465954:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616416896 00000100:00100000:3.0:1787135957.465958:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616416896 00000100:00100000:3.0:1787135957.465985:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787135957.465992:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616416896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787135957.466012:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135957.466044:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876caf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616416896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135957.466261:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987485fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616416896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787135957.466364:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:2.0:1787135958.106034:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135958.713138:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135958.713262:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595437568 00000100:00100000:0.0:1787135958.713273:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595437568 00000100:00080000:3.0:1787135958.713446:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135958.713491:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:0.0:1787135958.713503:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:10225:x1873947595437568:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1787135958.713615:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876caea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:10225:x1873947595437568:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 Request processed in 115us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135958.713623:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 136 00000100:00100000:3.0:1787135958.716732:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135958.716936:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595437824 00000100:00100000:1.0:1787135958.716948:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595437824 00000100:00100000:1.0:1787135958.717003:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:1.0:1787135958.717014:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:10225:x1873947595437824:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787135958.717534:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:10225:x1873947595437824:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 521us (808us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787135958.717543:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00010000:00010000:0.0:1787135959.128510:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135959.165187:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135959.165339:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595437952 00000100:00100000:0.0:1787135959.165349:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595437952 00000100:00100000:0.0:1787135959.165435:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 137 00000100:00100000:0.0:1787135959.165447:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:11024:x1873947595437952:12345-192.168.203.38@tcp:101:lsof.0 00010000:00010000:0.0:1787135959.165466:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135959.165493:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202d0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183e3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135959.165554:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202d11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135959.165568:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202d11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135959.165579:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202d11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135959.165796:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787135959.165801:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000100:00080000:3.0:1787135959.166164:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1787135959.166249:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202d11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135959.166276:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202d0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183e3 expref: 7 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135959.166298:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202d11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183e3 expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135959.166317:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:0.0:1787135959.166320:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787135959.166323:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896a00, rc 0) 00000100:00100000:0.0:1787135959.166414:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:11024:x1873947595437952:12345-192.168.203.38@tcp:101:lsof.0 Request processed in 969us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135959.166421:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 137 00000001:00080000:0.0:1787135960.054239:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787135960.054259:0:5844:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1787135960.056451:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1787135960.056467:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1787135960.069266:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:1.0:1787135960.152244:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787135960.344331:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787135960.344340:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787135960.344621:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1787135960.344628:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787135960.946115:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135960.946159:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135960.946217:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595438464 00000100:00100000:3.0:1787135960.946227:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595438464 00000100:00080000:0.0:1787135960.946277:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787135960.946311:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:3.0:1787135960.946322:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595438464:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135960.946354:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595438208 00000100:00100000:1.0:1787135960.946360:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595438208 00000100:00100000:3.0:1787135960.946391:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595438464:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 71us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135960.946400:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:1.0:1787135960.946413:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:1.0:1787135960.946423:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987485fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2359:x1873947595438208:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135960.946460:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987485fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2359:x1873947595438208:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 39us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135960.946467:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00080000:0.0:1787135960.946547:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135960.946799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135960.946889:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135960.948214:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595438336 00000100:00100000:0.0:1787135960.948224:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595438336 00000100:00100000:0.0:1787135960.948305:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:0.0:1787135960.948315:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595438336:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135960.948370:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2359:x1873947595438336:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 57us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135960.948377:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00080000:2.0:1787135960.948804:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787135960.956827:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135960.956880:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595438592 00000100:00100000:2.0:1787135960.956890:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595438592 00000100:00100000:2.0:1787135960.956952:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:2.0:1787135960.956965:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2359:x1873947595438592:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135960.957030:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2359:x1873947595438592:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 70us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135960.957038:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:1.0:1787135960.957503:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595438080 00000100:00100000:1.0:1787135960.957510:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595438080 00000100:00100000:1.0:1787135960.957739:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 288 00000100:00100000:1.0:1787135960.957749:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595438080:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135960.958839:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595438080:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 1085us (12032us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135960.958851:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 288 00010000:00010000:0.0:1787135961.176779:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135962.072472:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616417280:0@lo:400:kworker.0 00000100:00100000:2.0:1787135962.072537:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135962.072596:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787135962.072613:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616417408:0@lo:400:kworker.0 00000100:00100000:2.0:1787135962.072642:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135962.072889:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616417024:0@lo:400:kworker.0 00000100:00100000:1.0:1787135962.072926:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135962.072960:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616417536:0@lo:400:kworker.0 00000100:00100000:1.0:1787135962.073009:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135962.073030:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787135962.073036:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616417152:0@lo:400:kworker.0 00000100:00100000:1.0:1787135962.073097:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135962.073119:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616417664:0@lo:400:kworker.0 00000100:00100000:1.0:1787135962.073142:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135962.073183:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616417280 00000100:00100000:1.0:1787135962.073190:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616417280 00000100:00100000:1.0:1787135962.073238:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616417536 00000100:00100000:1.0:1787135962.073241:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616417536 00000100:00100000:1.0:1787135962.073255:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616417152 00000100:00100000:1.0:1787135962.073258:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616417152 00000100:00100000:1.0:1787135962.073273:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787135962.073291:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616417280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135962.073353:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616417280:12345-0@lo:400:kworker.0 Request processed in 72us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135962.073360:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787135962.073377:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787135962.073384:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616417536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135962.073415:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616417536:12345-0@lo:400:kworker.0 Request processed in 32us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135962.073421:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787135962.073433:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787135962.073439:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616417152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135962.073466:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616417152:12345-0@lo:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135962.073481:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:1.0:1787135962.073501:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135962.073533:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616417280:0@lo:400:kworker.0 00000100:00100000:1.0:1787135962.073565:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616417152:0@lo:400:kworker.0 00000100:00100000:1.0:1787135962.073573:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616417536:0@lo:400:kworker.0 00000100:00100000:3.0:1787135962.074354:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616417408 00000100:00100000:3.0:1787135962.074362:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616417408 00000100:00100000:3.0:1787135962.074407:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616417664 00000100:00100000:3.0:1787135962.074410:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616417664 00000100:00100000:3.0:1787135962.074436:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787135962.074457:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616417408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135962.074525:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616417408:12345-0@lo:400:kworker.0 Request processed in 69us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135962.074532:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787135962.074546:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787135962.074552:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616417664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135962.074595:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616417664:12345-0@lo:400:kworker.0 Request processed in 43us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135962.074602:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787135962.074652:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616417408:0@lo:400:kworker.0 00000100:00100000:3.0:1787135962.074679:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787135962.074684:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e987420bb80, transno 4294967312 00000100:00100000:3.0:1787135962.074695:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616417664:0@lo:400:kworker.0 00000100:00080000:1.0:1787135962.076648:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787135962.076657:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787135962.077206:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616417024 00000100:00100000:2.0:1787135962.077217:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616417024 00000100:00100000:2.0:1787135962.077278:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1787135962.077297:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616417024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135962.077406:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616417024:12345-0@lo:400:kworker.0 Request processed in 111us (4478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135962.077413:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787135962.078115:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616417024:0@lo:400:kworker.0 00010000:00010000:2.0:1787135962.204209:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135962.586231:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616417792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135962.586318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135962.586436:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616417792 00000100:00100000:3.0:1787135962.586445:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616417792 00000100:00100000:3.0:1787135962.586524:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787135962.586534:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616417792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787135962.586569:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135962.586614:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616417792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135962.586621:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787135962.591676:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616417792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135962.591705:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787135962.591716:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616417920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135962.591787:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135962.595307:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616417920 00000100:00100000:0.0:1787135962.595321:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616417920 00000100:00100000:0.0:1787135962.595386:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787135962.595396:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616417920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787135962.595434:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787135962.595526:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616417920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (3738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135962.595534:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787135962.602343:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842bf2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616417920:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787135962.942891:0:12287:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 06:39:21 (1787135961) 00010000:00010000:2.0:1787135963.224314:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135964.248637:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135964.376633:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135964.376802:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595438848 00000100:00100000:0.0:1787135964.376812:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595438848 00000100:00100000:0.0:1787135964.376888:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:0.0:1787135964.376899:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:11288:x1873947595438848:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787135964.376920:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135964.376938:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202d18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183ea expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.377197:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202d1f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.377214:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202d1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.377225:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202d1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.377240:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202d26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.377247:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202d26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.377254:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202d26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787135964.377680:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787135964.380072:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202d2d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380103:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202d2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380114:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202d2d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135964.380124:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787135964.380302:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202d1f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380310:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202d1f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380318:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202d1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380324:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135964.380329:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202d1f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380337:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202d1f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380350:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e98532d1800) 00010000:00010000:0.0:1787135964.380353:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135964.380358:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202d1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380364:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202d1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380376:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202d26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380389:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202d26 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380394:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202d26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380400:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135964.380403:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202d26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380410:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202d26 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380417:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e98494a1200) 00010000:00010000:0.0:1787135964.380420:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135964.380423:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202d26 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380428:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202d26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380771:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202d18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ea expref: 16 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380786:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202d2d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ea expref: 15 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.380793:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9853809600) 00010000:00010000:0.0:1787135964.380796:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135964.380804:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897800, rc 0) 00000100:00100000:0.0:1787135964.380876:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:11288:x1873947595438848:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 3979us (4250us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787135964.380886:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 138 00000100:00100000:3.0:1787135964.383379:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135964.383807:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595438976 00000100:00100000:0.0:1787135964.383816:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595438976 00000100:00100000:0.0:1787135964.383929:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1787135964.383940:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:2359:x1873947595438976:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135964.383954:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135964.383985:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202d2d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ea expref: 15 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135964.384004:0:7612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9853809600) 00010000:00010000:0.0:1787135964.384008:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135964.384076:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:2359:x1873947595438976:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 138us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135964.384083:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:2.0:1787135964.385351:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135964.385400:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595439104 00000100:00100000:2.0:1787135964.385407:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595439104 00000100:00100000:2.0:1787135964.385446:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 139 00000100:00100000:2.0:1787135964.385455:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:11288:x1873947595439104:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787135964.385550:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:11288:x1873947595439104:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 Request processed in 96us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135964.385558:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 139 00000040:00080000:1.0:1787135964.440368:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787135964.440377:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787135964.440409:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1787135964.440415:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787135965.192578:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:2.0:1787135965.273369:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135966.056316:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135966.056361:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135966.056428:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135966.056450:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135966.056475:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135966.056500:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595439488 00000100:00100000:3.0:1787135966.056521:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595439488 00000100:00100000:3.0:1787135966.056584:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595439616 00000100:00100000:3.0:1787135966.056588:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595439616 00000100:00100000:3.0:1787135966.056613:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:3.0:1787135966.056624:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595439488:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135966.056704:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595439488:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 81us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135966.056712:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:3.0:1787135966.056730:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:3.0:1787135966.056737:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595439616:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135966.056761:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595439616:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135966.056767:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00080000:3.0:1787135966.056784:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787135966.056788:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787135966.056933:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595439360 00000100:00100000:2.0:1787135966.056938:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595439360 00000100:00100000:2.0:1787135966.056977:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595439744 00000100:00100000:2.0:1787135966.056981:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595439744 00000100:00100000:2.0:1787135966.057016:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:2.0:1787135966.057024:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2359:x1873947595439360:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135966.057077:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2359:x1873947595439360:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 54us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135966.057084:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:2.0:1787135966.057098:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:2.0:1787135966.057104:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2360:x1873947595439744:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135966.057128:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2360:x1873947595439744:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135966.057134:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 144 00000100:00080000:3.0:1787135966.057311:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135966.057831:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595439232 00000100:00100000:0.0:1787135966.057838:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595439232 00000100:00100000:0.0:1787135966.057870:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 290 00000100:00100000:0.0:1787135966.057878:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595439232:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135966.057949:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+13:2360:x1873947595439232:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 72us (1587us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135966.057958:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 290 00000100:00100000:0.0:1787135966.185310:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135966.185490:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595439872 00000100:00100000:1.0:1787135966.185499:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595439872 00000100:00100000:1.0:1787135966.185630:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:1.0:1787135966.185641:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:11331:x1873947595439872:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787135966.185660:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135966.185679:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202d3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183f1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.185735:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202d42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.185750:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.185775:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.185790:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.185796:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.185802:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186040:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186067:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202d42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186074:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186090:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aee00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135966.186095:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186103:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202d42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186115:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:1.0:1787135966.186119:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135966.186124:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186137:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186148:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186154:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202d49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186160:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186165:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533af200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135966.186168:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186176:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202d49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186185:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e9853809900) 00010000:00010000:1.0:1787135966.186188:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135966.186191:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202d49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186197:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202d49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186228:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202d3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183f1 expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186247:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:1.0:1787135966.186250:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135966.186265:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202d3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183f1 expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.186274:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533ae000, rc 0) 00000100:00100000:1.0:1787135966.186340:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:11331:x1873947595439872:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 701us (1036us total) trans 0 rc 301/301 00000100:00100000:1.0:1787135966.186347:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 140 00000100:00100000:3.0:1787135966.189869:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135966.190101:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595440128 00000100:00100000:2.0:1787135966.190122:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595440128 00000100:00100000:2.0:1787135966.190185:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 141 00000100:00100000:2.0:1787135966.190196:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:11331:x1873947595440128:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:2.0:1787135966.190262:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135966.190289:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f2026b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718223 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.190309:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:2.0:1787135966.190314:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135966.190582:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.190598:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202d11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183e3 expref: 5 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.190618:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.190652:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202d11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183e3 expref: 5 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.190666:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202d11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183e3 expref: 5 pid: 5821 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135966.190680:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1873947616418048:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135966.191091:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787135966.195498:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135966.195600:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1873947616418048:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787135966.195638:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135966.195919:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595440256 00000100:00100000:2.0:1787135966.195927:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595440256 00010000:00010000:2.0:1787135966.195962:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202d11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183e3 expref: 6 pid: 5821 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135966.196004:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:2.0:1787135966.196014:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2359:x1873947595440256:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135966.196030:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135966.196037:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202d11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183e3 expref: 6 pid: 5821 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.196077:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202d11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183e3 expref: 6 pid: 5821 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.196100:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202d11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183e3 expref: 6 pid: 5821 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.196129:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:2.0:1787135966.196135:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.196143:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.196150:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.196168:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135966.196216:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2359:x1873947595440256:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 204us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135966.196224:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00010000:00010000:0.0:1787135966.196576:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.196586:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.196609:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d57 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.196619:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.196627:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135966.200328:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787135966.200717:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.200730:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.200738:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.200743:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135966.200747:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.200818:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.200843:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e9843179300) 00010000:00010000:0.0:1787135966.200846:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135966.200851:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.200857:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d50 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787135966.200878:0:5823:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000ccfaa3f5 reply state 00000000a425e9d7 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135966.200887:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787135966.201203:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:11331:x1873947595440128:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 11006us (11340us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787135966.201213:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 141 00010000:00010000:0.0:1787135966.202590:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d57 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.202616:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d57 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.202623:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d57 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.202629:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135966.202634:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d57 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.202641:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d57 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.202670:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e98494a1a00) 00010000:00010000:0.0:1787135966.202673:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135966.202677:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d57 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.202683:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d57 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.296718:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135966.305337:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135966.305571:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595440384 00000100:00100000:0.0:1787135966.305581:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595440384 00000100:00100000:0.0:1787135966.305632:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:0.0:1787135966.305643:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:11339:x1873947595440384:12345-192.168.203.38@tcp:101:lctl.0 00010000:00010000:0.0:1787135966.305666:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135966.305685:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183f8 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.305747:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202d65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.305760:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202d65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.305772:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202d65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135966.305830:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787135966.305834:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787135966.305861:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202d65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.305896:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202d5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183f8 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.305913:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202d65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183f8 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.305922:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:0.0:1787135966.305925:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787135966.305928:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896400, rc 0) 00000100:00100000:0.0:1787135966.305993:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:11339:x1873947595440384:12345-192.168.203.38@tcp:101:lctl.0 Request processed in 352us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135966.306001:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 142 00000100:00100000:0.0:1787135966.370717:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135966.372875:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595440512 00000100:00100000:2.0:1787135966.372890:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595440512 00000100:00100000:2.0:1787135966.372953:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:2.0:1787135966.372962:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:11345:x1873947595440512:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1787135966.372981:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135966.372999:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202d6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7183ff expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.373080:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202d73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.373094:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202d73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.373114:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202d73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.373128:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202d7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.373135:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.373141:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.373238:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202d81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.373246:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.373263:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135966.373292:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787135966.373295:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135966.373314:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374124:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202d73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374137:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202d73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374153:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202d73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374159:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135966.374164:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202d73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374171:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202d73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374184:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:2.0:1787135966.374186:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135966.374191:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202d73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374197:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202d73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374207:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202d7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374213:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202d7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374218:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202d7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374223:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135966.374226:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202d7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374241:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202d7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374249:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e98532d1700) 00010000:00010000:2.0:1787135966.374261:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135966.374265:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202d7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374271:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202d7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374305:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202d6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ff expref: 16 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374319:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202d81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ff expref: 15 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.374338:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:2.0:1787135966.374340:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787135966.374343:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6400, rc 0) 00000100:00100000:2.0:1787135966.374413:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:11345:x1873947595440512:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1451us (3704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135966.374420:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 143 00000100:00100000:3.0:1787135966.380928:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135966.381025:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595440768 00000100:00100000:2.0:1787135966.381032:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595440768 00000100:00100000:2.0:1787135966.381097:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 144 00000100:00100000:2.0:1787135966.381111:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+15:11345:x1873947595440768:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1787135966.381138:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135966.381162:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718406 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.381292:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202d8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.381306:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202d8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.381315:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202d8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.381379:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202d96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.381387:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.381394:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787135966.382924:0:5822:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787135966.384665:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202d9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.384686:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.384696:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.384747:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202d8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.384755:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202d8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.384761:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202d8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.384767:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135966.384771:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202d8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.384778:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202d8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.384789:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:2.0:1787135966.384791:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135966.384795:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202d8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.384801:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202d8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787135966.384813:0:5822:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000004c2bfaf5 reply state 0000000056b1341d transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135966.384821:0:5822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787135966.384856:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202d88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718406 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.384883:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718406 expref: 17 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.384892:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98532d1000) 00010000:00010000:2.0:1787135966.384895:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787135966.384897:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6e00, rc 0) 00000100:00100000:2.0:1787135966.391176:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:11345:x1873947595440768:12345-192.168.203.38@tcp:101:bash.0 Request processed in 10057us (10247us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787135966.391190:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 144 00010000:00010000:3.0:1787135966.401427:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202d96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.401444:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202d96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.401460:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202d96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.401468:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135966.401473:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202d96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.401481:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202d96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.401497:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e98532d1b00) 00010000:00010000:3.0:1787135966.401499:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135966.401503:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202d96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.401509:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202d96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135966.402841:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135966.403929:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595440896 00000100:00100000:0.0:1787135966.404174:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595440896 00000100:00100000:0.0:1787135966.404238:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:0.0:1787135966.404248:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2360:x1873947595440896:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1787135966.404276:0:11994:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135966.404297:0:11994:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036043a2f/0xf5850c552f202dab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71840d expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787135966.404657:0:11994:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787135966.404675:0:11994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1787135966.404678:0:11994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135966.404685:0:11994:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036043a2f/0xf5850c552f202dab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71840d expref: 6 pid: 11994 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.404716:0:11994:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000036043a2f/0xf5850c552f202dab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71840d expref: 6 pid: 11994 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.404733:0:11994:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896200, rc 0) 00000100:00100000:0.0:1787135966.404790:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595440896:12345-192.168.203.38@tcp:101:bash.0 Request processed in 545us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135966.404796:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:0.0:1787135966.413086:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135966.413176:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595441024 00000100:00100000:3.0:1787135966.413186:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595441024 00000100:00100000:3.0:1787135966.413279:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:3.0:1787135966.413293:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:11345:x1873947595441024:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1787135966.413463:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135966.413484:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718414 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.413518:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000036043a2f/0xf5850c552f202dab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71840d expref: 7 pid: 11994 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.413530:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135966.413535:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135966.413541:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.413573:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000036043a2f/0xf5850c552f202dab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71840d expref: 7 pid: 11994 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.413588:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000036043a2f/0xf5850c552f202dab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71840d expref: 7 pid: 11994 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135966.413637:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1873947616418176:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135966.413784:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787135966.416006:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1873947616418176:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135966.416038:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 7 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.416110:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7a00, rc 0) 00000100:00100000:2.0:1787135966.416155:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:11345:x1873947595441024:12345-192.168.203.38@tcp:101:bash.0 Request processed in 2866us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135966.416164:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:3.0:1787135966.417141:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135966.417300:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595441152 00000100:00100000:1.0:1787135966.417308:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595441152 00010000:00010000:1.0:1787135966.417408:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000036043a2f/0xf5850c552f202dab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71840d expref: 7 pid: 11994 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135966.417448:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:1.0:1787135966.417522:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987482a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595441152:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787135966.417536:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135966.417616:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000036043a2f/0xf5850c552f202dab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71840d expref: 7 pid: 11994 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.417631:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000036043a2f/0xf5850c552f202dab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71840d expref: 7 pid: 11994 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.417652:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036043a2f/0xf5850c552f202dab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71840d expref: 7 pid: 11994 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.417679:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787135966.417683:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787135966.417690:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.417698:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.417729:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135966.417742:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e11f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873947616418304:192.168.203.38@tcp:105: 00000100:00100000:1.0:1787135966.417812:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e97452856c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135966.425042:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e11f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873947616418304:192.168.203.38@tcp:105: 00010000:00010000:1.0:1787135966.425093:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135966.425146:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987482a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595441152:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 7689us (8007us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135966.425157:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:3.0:1787135966.433767:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135966.435099:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595441408 00000100:00100000:1.0:1787135966.435110:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595441408 00000100:00100000:1.0:1787135966.435173:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:1.0:1787135966.435184:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+17:11345:x1873947595441408:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:1.0:1787135966.435526:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:11345:x1873947595441408:12345-192.168.203.38@tcp:35:bash.0 Request processed in 344us (1767us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787135966.435558:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:3.0:1787135966.525923:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135966.526087:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595441664 00000100:00100000:0.0:1787135966.526096:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595441664 00000100:00100000:0.0:1787135966.526158:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 145 00000100:00100000:0.0:1787135966.526169:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:11355:x1873947595441664:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1787135966.526193:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135966.526213:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202db9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71841b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135966.526336:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787135966.526450:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202db9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71841b expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.526465:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:0.0:1787135966.526468:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787135966.526473:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f202db9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71841b expref: 20 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.526504:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896e00, rc 0) 00000100:00100000:0.0:1787135966.526567:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:11355:x1873947595441664:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 400us (653us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1787135966.526574:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 145 00000100:00100000:0.0:1787135966.529167:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135966.529269:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595441920 00000100:00100000:3.0:1787135966.529279:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595441920 00000100:00100000:3.0:1787135966.529356:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:3.0:1787135966.529370:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:11355:x1873947595441920:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1787135966.529625:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:11355:x1873947595441920:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 259us (468us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787135966.529632:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:3.0:1787135966.644706:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135966.644872:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595442048 00000100:00100000:2.0:1787135966.644883:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595442048 00000100:00100000:2.0:1787135966.644940:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:2.0:1787135966.645139:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:11361:x1873947595442048:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135966.645166:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135966.645185:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202dc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718422 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.645245:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202dce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.645268:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.645280:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135966.645353:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787135966.645356:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135966.645380:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202dce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.645407:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202dc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718422 expref: 22 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.645425:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202dce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718422 expref: 21 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.645435:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:2.0:1787135966.645438:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787135966.645442:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7800, rc 0) 00000100:00100000:2.0:1787135966.647565:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:11361:x1873947595442048:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 2607us (2966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135966.647577:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 146 00000100:00100000:2.0:1787135966.652419:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135966.653316:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595442304 00000100:00100000:0.0:1787135966.653326:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595442304 00000100:00100000:0.0:1787135966.653386:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 147 00000100:00100000:0.0:1787135966.653395:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:11361:x1873947595442304:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1787135966.653415:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135966.653434:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202dd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718429 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.653534:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202ddc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.653551:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.653563:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202ddc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135966.653574:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787135966.653702:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202dd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718429 expref: 24 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.653721:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202ddc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718429 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.653742:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98532d1000) 00010000:00010000:0.0:1787135966.653755:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787135966.653759:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897800, rc 0) 00000100:00100000:0.0:1787135966.654220:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:11361:x1873947595442304:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 824us (1808us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1787135966.654229:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 147 00000100:00100000:0.0:1787135966.663663:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135966.663954:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135966.665027:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595442432 00000100:00100000:2.0:1787135966.665039:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595442432 00000100:00100000:2.0:1787135966.665128:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1787135966.665138:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:2361:x1873947595442432:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135966.665153:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135966.665177:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202ddc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718429 expref: 23 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.665196:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98532d1000) 00010000:00010000:2.0:1787135966.665213:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135966.665276:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:2361:x1873947595442432:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 139us (1621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135966.665284:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1787135966.665508:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595442688 00000100:00100000:1.0:1787135966.665513:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595442688 00000100:00100000:1.0:1787135966.665542:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:1.0:1787135966.665550:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:11361:x1873947595442688:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787135966.665568:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135966.665581:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202dea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718430 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.665674:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202df1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.665688:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202df1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.665699:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202df1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135966.665712:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787135966.665829:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202dea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718430 expref: 25 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.665844:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202df1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718430 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.665852:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98532d1000) 00010000:00010000:1.0:1787135966.665855:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787135966.665858:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533af200, rc 0) 00000100:00100000:1.0:1787135966.665890:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:11361:x1873947595442688:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 341us (1946us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1787135966.665897:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:3.0:1787135966.678367:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135966.678473:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595442816 00000100:00100000:0.0:1787135966.678482:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595442816 00000100:00100000:0.0:1787135966.678537:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:0.0:1787135966.678546:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2360:x1873947595442816:12345-192.168.203.38@tcp:1:lfs.0 00010000:00010000:0.0:1787135966.678588:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.678617:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.678627:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135966.678631:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787135966.678636:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.678673:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 6 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.678706:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 6 pid: 6672 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135966.678721:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c0d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6673:1873947616418432:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135966.678816:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aef3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135966.681278:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c0d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6673:1873947616418432:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135966.681306:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135966.685202:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135966.685463:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595442944 00000100:00100000:0.0:1787135966.685473:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595442944 00002000:00100000:0.0:1787135966.685522:0:6680:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e987c4c3100 x1873947595442944/t0(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:392/0 lens 504/0 e 0 to 0 dl 1787135977 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787135966.685534:0:6680:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e987c4c3100 with x1873947595442944 ext(0->12) 00010000:00010000:0.0:1787135966.685544:0:6680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 7 pid: 6672 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.685561:0:6680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 7 pid: 6672 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787135966.685570:0:6680:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e987c4c3100 00000100:00100000:0.0:1787135966.685602:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1787135966.685612:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595442944:12345-192.168.203.38@tcp:4:lfs.0 00000100:00100000:0.0:1787135966.686488:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2360:x1873947595442944:12345-192.168.203.38@tcp:4:lfs.0 Request processed in 874us (1292us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787135966.686498:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00002000:00100000:0.0:1787135966.686506:0:6680:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e987c4c3100 x1873947595442944/t4294967305(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:392/0 lens 504/448 e 0 to 0 dl 1787135977 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787135966.686527:0:6680:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e987c4c3100 with x1873947595442944 ext(0->12) 00010000:00010000:0.0:1787135966.686534:0:6680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 9 pid: 6672 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.686549:0:6680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 9 pid: 6672 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787135966.686557:0:6680:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e987c4c3100 00000100:00100000:0.0:1787135966.693673:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135966.693775:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595443072 00000100:00100000:1.0:1787135966.693785:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595443072 00010000:00010000:1.0:1787135966.693825:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 9 pid: 6672 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135966.693869:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:1.0:1787135966.693880:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2359:x1873947595443072:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787135966.693894:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1787135966.693911:0:7612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787135966.693914:0:7612:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787135966 00002000:00010000:1.0:1787135966.693917:0:7612:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787135966 00002000:00010000:1.0:1787135966.693919:0:7612:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787135966 00010000:00010000:1.0:1787135966.693925:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 9 pid: 6672 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.693939:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 9 pid: 6672 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.693973:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007543cd90/0xf5850c552f202db2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718414 expref: 9 pid: 6672 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.693990:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787135966.693994:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787135966.694000:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.694023:0:7612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.694100:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135966.694146:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2359:x1873947595443072:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 267us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135966.694153:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00010000:00010000:3.0:1787135966.694817:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.694830:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.694856:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.694864:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.694886:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.694893:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787135966.694898:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.694907:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.694921:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.694929:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f202dff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135966.695038:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595442816:12345-192.168.203.38@tcp:1:lfs.0 Request processed in 16492us (16680us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135966.695084:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:0.0:1787135966.707023:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135966.707227:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595443328 00000100:00100000:3.0:1787135966.707237:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595443328 00000100:00100000:3.0:1787135966.707300:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:3.0:1787135966.707310:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9860737c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:11361:x1873947595443328:12345-192.168.203.38@tcp:35:lfs.0 00000004:00010000:3.0:1787135966.707372:0:5824:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202df1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718430 expref: 24 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787135966.707621:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1787135966.707662:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1787135966.708176:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1787135966.708230:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.708246:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202d9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718406 expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.708265:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.708297:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718406 expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.708313:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202d9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718406 expref: 28 pid: 5822 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135966.708328:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5824:1873947616418560:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135966.708401:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457dbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135966.710402:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5824:1873947616418560:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135966.710429:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135966.710759:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135966.711102:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595443456 00000100:00100000:2.0:1787135966.711110:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595443456 00010000:00010000:2.0:1787135966.711144:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202d9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718406 expref: 29 pid: 5822 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135966.711181:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:2.0:1787135966.711190:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+29:2359:x1873947595443456:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135966.711204:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135966.711210:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202d9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718406 expref: 29 pid: 5822 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.711223:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718406 expref: 29 pid: 5822 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.711244:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202d9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718406 expref: 29 pid: 5822 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.711268:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98532d1000) 00010000:00010000:2.0:1787135966.711274:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.711282:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.711288:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135966.711333:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135966.711385:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457ca050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+28:2359:x1873947595443456:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 195us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135966.711392:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00010000:00010000:1.0:1787135966.711491:0:5824:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.711500:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787135966.711606:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1787135966.711790:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1787135966.711907:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e11f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1873947616418688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787135966.711962:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135966.711994:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9745285600 going to sleep for 11 seconds 00000100:00100000:2.0:1787135966.712232:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616418688 00000100:00100000:2.0:1787135966.712237:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616418688 00000100:00100000:2.0:1787135966.712290:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787135966.712297:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1873947616418688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787135966.712359:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1873947616418688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 62us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135966.712366:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787135966.712422:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787135966.712565:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e11f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1873947616418688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787135966.712996:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1787135966.713082:0:5824:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e11f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1873947616418816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787135966.713112:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135966.713132:0:5824:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e97452856c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135966.713306:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616418816 00000100:00100000:2.0:1787135966.713312:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616418816 00000100:00100000:2.0:1787135966.713337:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787135966.713344:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5824:x1873947616418816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787135966.713485:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5824:x1873947616418816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 141us (372us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787135966.713493:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787135966.713595:0:5824:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e11f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5824:1873947616418816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1787135966.713633:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1787135966.713675:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.713686:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.713693:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.713700:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840030200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135966.713705:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.713713:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.713726:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98532d1000) 00010000:00010000:1.0:1787135966.713729:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787135966.713733:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.713739:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e06 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787135966.713884:0:5824:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787135966.714260:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1787135966.714272:0:5824:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326657223217ns, next at 327657221137ns, rc = 0 00000001:00080000:1.0:1787135966.714279:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1787135966.714310:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98532d1000) 00010000:00010000:1.0:1787135966.714314:0:5824:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787135966.714321:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202df1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718430 expref: 32 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135966.714411:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9860737c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+31:11361:x1873947595443328:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 7102us (7397us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1787135966.714421:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00000020:00080000:1.0:1787135966.714427:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787135966.716362:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135966.716437:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595443584 00000100:00100000:3.0:1787135966.716445:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595443584 00000100:00100000:3.0:1787135966.716507:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:3.0:1787135966.716516:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+31:11361:x1873947595443584:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135966.716537:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135966.716556:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202e0d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718437 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.716609:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202e0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718437 expref: 32 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.716622:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202e0d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718437 expref: 32 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.716639:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:3.0:1787135966.716643:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135966.716646:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9840031800, rc 0) 00000100:00100000:3.0:1787135966.716702:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:11361:x1873947595443584:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 187us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135966.716709:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:0.0:1787135966.718985:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135966.719214:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595443840 00000100:00100000:1.0:1787135966.719224:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595443840 00000100:00100000:1.0:1787135966.719287:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:1.0:1787135966.719295:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:11361:x1873947595443840:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1787135966.719500:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+33:11361:x1873947595443840:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 205us (521us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787135966.719507:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:2.0:1787135966.817443:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135966.817587:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595444096 00000100:00100000:1.0:1787135966.817597:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595444096 00000100:00100000:1.0:1787135966.817660:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:1.0:1787135966.817671:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+33:11371:x1873947595444096:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787135966.817693:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135966.817713:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202e14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71843e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135966.817834:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787135966.817961:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202e14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71843e expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.817976:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:1.0:1787135966.817979:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787135966.817999:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202e14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71843e expref: 35 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.818014:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533af200, rc 0) 00000100:00100000:1.0:1787135966.818130:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:11371:x1873947595444096:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 461us (696us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1787135966.818137:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 150 00000100:00100000:0.0:1787135966.821105:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135966.821269:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595444224 00000100:00100000:3.0:1787135966.821279:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595444224 00000100:00100000:3.0:1787135966.821337:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:3.0:1787135966.821345:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:11371:x1873947595444224:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:3.0:1787135966.821412:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821430:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821469:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821486:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821495:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821501:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821601:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821610:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821618:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787135966.821655:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821669:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821677:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821684:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821702:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840030200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135966.821707:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821716:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821729:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:3.0:1787135966.821732:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135966.821736:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821742:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030200/0xf5850c552f202e22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821768:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821775:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821782:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821787:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e3a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135966.821791:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821797:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821816:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9843179000) 00010000:00010000:3.0:1787135966.821819:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135966.821822:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821828:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821844:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821850:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821857:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821862:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e3400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135966.821865:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821872:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821879:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:3.0:1787135966.821882:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135966.821885:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.821891:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135966.821961:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:11371:x1873947595444224:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 616us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135966.821969:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 151 00000100:00100000:3.0:1787135966.825541:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135966.825723:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595444480 00000100:00100000:1.0:1787135966.825733:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595444480 00000100:00100000:1.0:1787135966.825793:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:1.0:1787135966.825802:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:11371:x1873947595444480:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1787135966.826078:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+35:11371:x1873947595444480:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 247us (516us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1787135966.826086:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:2.0:1787135966.887979:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135966.888150:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595444736 00000100:00100000:1.0:1787135966.888161:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595444736 00000100:00100000:1.0:1787135966.888222:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 152 00000100:00100000:1.0:1787135966.888233:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+35:11374:x1873947595444736:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787135966.888265:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135966.888284:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202e37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718445 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888355:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202e3e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888370:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202e3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888396:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202e3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888409:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202e45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888416:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888423:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888536:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202e4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888545:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888552:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202e4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135966.888561:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787135966.888648:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202e3e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888655:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202e3e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888661:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202e3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888666:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aee00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135966.888676:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202e3e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888683:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202e3e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888694:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:1.0:1787135966.888697:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135966.888702:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202e3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888708:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f202e3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888720:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202e45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888726:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202e45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888731:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202e45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888736:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aea00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135966.888738:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202e45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888742:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202e45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888748:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9853809900) 00010000:00010000:1.0:1787135966.888750:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135966.888758:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202e45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135966.888764:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aea00/0xf5850c552f202e45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.889575:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f202e37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718445 expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.889603:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718445 expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135966.889611:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135966.889613:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787135966.889616:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533ae000, rc 0) 00000100:00100000:0.0:1787135966.889685:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+37:11374:x1873947595444736:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1453us (1713us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1787135966.889694:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 152 00000100:00100000:0.0:1787135966.894159:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135966.894721:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595444864 00000100:00100000:3.0:1787135966.894734:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595444864 00000100:00100000:3.0:1787135966.894823:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:3.0:1787135966.894836:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+37:11374:x1873947595444864:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:3.0:1787135966.894903:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.894919:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.894930:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.894966:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.894972:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.894978:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.894983:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e3400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135966.894988:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.895007:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.895026:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:3.0:1787135966.895029:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787135966.895034:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e5a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135966.895040:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135966.895141:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+37:11374:x1873947595444864:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 308us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135966.895149:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:3.0:1787135966.898655:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135966.898723:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595445120 00000100:00100000:1.0:1787135966.898732:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595445120 00000100:00100000:1.0:1787135966.898787:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1787135966.898814:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+37:11374:x1873947595445120:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1787135966.899040:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+38:11374:x1873947595445120:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 234us (392us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1787135966.899089:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1787135967.193442:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616418944:0@lo:400:kworker.0 00000100:00100000:3.0:1787135967.193513:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135967.193574:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616419456:0@lo:400:kworker.0 00000100:00100000:3.0:1787135967.193603:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135967.193626:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787135967.193633:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616419072:0@lo:400:kworker.0 00000100:00100000:3.0:1787135967.193658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135967.193674:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616419584:0@lo:400:kworker.0 00000100:00100000:3.0:1787135967.193697:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135967.193730:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616419584 00000100:00100000:3.0:1787135967.193737:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616419584 00000100:00100000:3.0:1787135967.193801:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787135967.193841:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616419584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135967.193893:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616419584:12345-0@lo:400:kworker.0 Request processed in 55us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135967.193901:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1787135967.193920:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787135967.193946:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616419584:0@lo:400:kworker.0 00000100:00100000:0.0:1787135967.194222:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616419456 00000100:00100000:0.0:1787135967.194227:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616419456 00000100:00100000:0.0:1787135967.194266:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616419072 00000100:00100000:0.0:1787135967.194270:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616419072 00000100:00100000:0.0:1787135967.194291:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787135967.194298:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987bd35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616419456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135967.194337:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987bd35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616419456:12345-0@lo:400:kworker.0 Request processed in 39us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135967.194344:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787135967.194358:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787135967.194364:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616419072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135967.194389:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616419072:12345-0@lo:400:kworker.0 Request processed in 26us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135967.194396:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787135967.194707:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616419200:0@lo:400:kworker.0 00000100:00100000:2.0:1787135967.194739:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135967.194771:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787135967.194777:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616419328:0@lo:400:kworker.0 00000100:00100000:2.0:1787135967.194828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135967.194858:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616419200 00000100:00100000:2.0:1787135967.194862:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616419200 00000100:00100000:2.0:1787135967.194887:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787135967.194893:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616419200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135967.194926:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616419200:12345-0@lo:400:kworker.0 Request processed in 33us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135967.194932:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787135967.194959:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616419200:0@lo:400:kworker.0 00000100:00100000:2.0:1787135967.194977:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616419328 00000100:00100000:2.0:1787135967.194979:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616419328 00000100:00100000:2.0:1787135967.195260:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787135967.195269:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1873947616419328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135967.195307:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1873947616419328:12345-0@lo:400:kworker.0 Request processed in 40us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135967.195313:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787135967.195338:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616419328:0@lo:400:kworker.0 00000100:00080000:3.0:1787135967.195439:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135967.195460:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616419072:0@lo:400:kworker.0 00000100:00100000:3.0:1787135967.195471:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616419456:0@lo:400:kworker.0 00000100:00100000:1.0:1787135967.195620:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616418944 00000100:00100000:1.0:1787135967.195625:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616418944 00000100:00100000:1.0:1787135967.195659:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787135967.195666:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616418944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135967.195712:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616418944:12345-0@lo:400:kworker.0 Request processed in 47us (2199us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135967.195718:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787135967.195838:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616418944:0@lo:400:kworker.0 00000100:00100000:2.0:1787135967.278649:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135967.278746:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595445376 00000100:00100000:0.0:1787135967.278756:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595445376 00000100:00100000:0.0:1787135967.278823:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 154 00000100:00100000:0.0:1787135967.278833:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+38:11405:x1873947595445376:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:0.0:1787135967.278856:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135967.278876:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202e61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71844c expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.278978:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202e68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.278990:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.279001:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202e68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135967.279025:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787135967.279168:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f202e61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71844c expref: 41 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.279187:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202e68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71844c expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.279196:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135967.279198:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787135967.279202:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897800, rc 0) 00000100:00100000:0.0:1787135967.279424:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+40:11405:x1873947595445376:12345-192.168.203.38@tcp:101:cat.0 Request processed in 591us (784us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787135967.279432:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 154 00000100:00100000:0.0:1787135967.282323:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135967.282400:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135967.282586:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595445632 00000100:00100000:1.0:1787135967.282596:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595445632 00000100:00100000:1.0:1787135967.282649:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:1.0:1787135967.282660:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+40:11405:x1873947595445632:12345-192.168.203.38@tcp:35:cat.0 00000100:00100000:1.0:1787135967.282897:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+41:11405:x1873947595445632:12345-192.168.203.38@tcp:35:cat.0 Request processed in 239us (583us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1787135967.282905:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:2.0:1787135967.283415:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595445760 00000100:00100000:2.0:1787135967.283421:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595445760 00000100:00100000:2.0:1787135967.283469:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:2.0:1787135967.283477:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+41:2359:x1873947595445760:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135967.283489:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135967.283512:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f202e68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71844c expref: 41 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.283544:0:7612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:2.0:1787135967.283549:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135967.283584:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+40:2359:x1873947595445760:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 108us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135967.283592:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00010000:00010000:2.0:1787135967.320640:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135967.379465:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135967.379581:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595446016 00000100:00100000:2.0:1787135967.379591:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595446016 00000100:00100000:2.0:1787135967.379660:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 155 00000100:00100000:2.0:1787135967.379671:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+40:11411:x1873947595446016:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1787135967.379694:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135967.379697:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787135967.379723:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202dce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718422 expref: 40 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.379741:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:2.0:1787135967.379746:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135967.379761:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202e76 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718453 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.379871:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.379885:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202e4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718445 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.379915:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.379964:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718445 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.379978:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202e4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718445 expref: 40 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135967.379992:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616419712:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135967.380130:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787135967.385529:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616419712:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135967.385558:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135967.388635:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135967.388711:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595446144 00000100:00100000:2.0:1787135967.388722:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595446144 00010000:00010000:2.0:1787135967.388762:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202e4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718445 expref: 41 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135967.388814:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:2.0:1787135967.388832:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+41:2359:x1873947595446144:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135967.388846:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135967.388854:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202e4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718445 expref: 41 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.388884:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202e4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718445 expref: 41 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.388907:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f202e4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718445 expref: 41 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.388922:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:2.0:1787135967.388926:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.388934:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.388947:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.388982:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135967.389041:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+40:2359:x1873947595446144:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 219us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135967.389078:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00010000:00010000:0.0:1787135967.389426:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.389434:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135967.389451:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787135967.389588:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202e76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718453 expref: 41 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.389604:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718453 expref: 40 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.389618:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135967.389620:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787135967.389623:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6e00, rc 0) 00000100:00100000:0.0:1787135967.389664:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+40:11411:x1873947595446016:12345-192.168.203.38@tcp:101:dd.0 Request processed in 9996us (10229us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1787135967.389671:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 155 00000100:00100000:0.0:1787135967.398700:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135967.398782:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595446400 00000100:00100000:2.0:1787135967.398791:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595446400 00000100:00100000:2.0:1787135967.398868:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 156 00000100:00100000:2.0:1787135967.398879:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+40:11411:x1873947595446400:12345-192.168.203.38@tcp:36:dd.0 00010000:00010000:2.0:1787135967.399182:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202e8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.399201:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202e8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135967.399227:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202e8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787135967.399287:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1787135967.399312:0:5821:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000489bdd5a reply state 00000000274c74c5 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202e8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135967.399321:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787135967.399403:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+43:11411:x1873947595446400:12345-192.168.203.38@tcp:36:dd.0 Request processed in 526us (711us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1787135967.399410:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 156 00000020:00080000:2.0:1787135967.399415:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787135967.412209:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202e8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.412227:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202e8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.412235:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202e8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.412241:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135967.412254:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202e8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.412263:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202e8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.412279:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135967.412282:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135967.412287:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202e8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.412293:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202e8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135967.704525:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616419968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135967.704596:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135967.704673:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787135967.704689:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616419840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135967.704724:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135967.705192:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616419968 00000100:00100000:1.0:1787135967.705201:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616419968 00000100:00100000:1.0:1787135967.705259:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616419840 00000100:00100000:1.0:1787135967.705262:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616419840 00000100:00100000:1.0:1787135967.705280:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787135967.705290:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616419968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787135967.705324:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135967.705375:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616419968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135967.705383:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787135967.705399:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787135967.705405:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616419840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787135967.705416:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135967.705442:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616419840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135967.705448:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787135967.705488:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616419840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787135967.707322:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616419968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135967.717928:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135967.718146:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595446528 00000100:00100000:3.0:1787135967.718163:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595446528 00000100:00100000:3.0:1787135967.718212:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 157 00000100:00100000:3.0:1787135967.718222:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+42:11425:x1873947595446528:12345-192.168.203.38@tcp:101:stat.0 00010000:00010000:3.0:1787135967.718253:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135967.718273:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71845a expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.718337:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.718351:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.718363:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.718389:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f202ea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.718397:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f202ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.718404:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f202ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.723006:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202ea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.723034:0:7623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718453 expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.723043:0:7623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202ea7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.723105:0:7623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718453 expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.723123:0:7623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718453 expref: 43 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135967.723139:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616420096:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135967.723259:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457dbcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135967.729115:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616420096:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135967.729145:0:7623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202ea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135967.730115:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135967.730271:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595446784 00000100:00100000:1.0:1787135967.730280:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595446784 00000100:00100000:1.0:1787135967.730342:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:1.0:1787135967.730353:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+44:5598:x1873947595446784:12345-192.168.203.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787135967.730668:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+45:5598:x1873947595446784:12345-192.168.203.38@tcp:35:ldlm_bl.0 Request processed in 316us (555us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1787135967.730676:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:2.0:1787135967.733460:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135967.733790:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595446912 00000100:00100000:3.0:1787135967.733801:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595446912 00010000:00010000:3.0:1787135967.733839:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718453 expref: 45 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135967.733921:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:3.0:1787135967.733932:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+45:2360:x1873947595446912:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787135967.733947:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135967.733955:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718453 expref: 45 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.733968:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718453 expref: 45 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.733991:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202e7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718453 expref: 45 pid: 5822 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.734008:0:7612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:3.0:1787135967.734013:0:7612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202ea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.734036:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.734044:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202ea7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.734097:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135967.734155:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+44:2360:x1873947595446912:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 225us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135967.734163:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 67 00010000:00010000:0.0:1787135967.734353:0:7623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.734363:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135967.734403:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787135967.734407:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787135967.734431:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.734444:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.734454:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.734461:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.734467:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.734473:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e3a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135967.734478:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.734486:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.735691:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:0.0:1787135967.735695:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135967.735700:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.735707:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f202e99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.735726:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f202ea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.735733:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f202ea0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.735738:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f202ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.735744:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135967.735747:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f202ea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.735753:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f202ea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.735761:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9843179000) 00010000:00010000:0.0:1787135967.735763:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135967.735766:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f202ea0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.735784:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f202ea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.735912:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202e92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71845a expref: 44 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.735929:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71845a expref: 43 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.736067:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135967.736070:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787135967.736073:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e3800, rc 0) 00000100:00100000:0.0:1787135967.736134:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+43:11425:x1873947595446528:12345-192.168.203.38@tcp:101:stat.0 Request processed in 17912us (18214us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135967.736142:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 157 00000100:00100000:2.0:1787135967.823092:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135967.823190:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595447168 00000100:00100000:0.0:1787135967.823200:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595447168 00000100:00100000:0.0:1787135967.823263:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:0.0:1787135967.823284:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+43:11431:x1873947595447168:12345-192.168.203.38@tcp:36:truncate.0 00010000:00010000:0.0:1787135967.823339:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135967.823366:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202ea7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71845a expref: 43 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.823386:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135967.823390:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787135967.823584:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202eae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.823598:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202eae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135967.823619:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202eae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787135967.823667:0:5821:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787135967.823692:0:5821:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000f27c43f0 reply state 000000002af9eef1 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202eae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135967.823701:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787135967.823792:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+45:11431:x1873947595447168:12345-192.168.203.38@tcp:36:truncate.0 Request processed in 519us (748us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787135967.823799:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 158 00000020:00080000:0.0:1787135967.823804:0:5821:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787135967.827342:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202eae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.827360:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202eae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.827368:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202eae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.827374:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135967.827380:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202eae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.827387:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202eae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.827402:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:3.0:1787135967.827405:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135967.827409:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202eae lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135967.827415:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202eae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135968.022177:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135968.022267:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595447296 00000100:00100000:0.0:1787135968.022278:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595447296 00000100:00100000:0.0:1787135968.022364:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:0.0:1787135968.022375:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+44:11445:x1873947595447296:12345-192.168.203.38@tcp:101:stat.0 00010000:00010000:0.0:1787135968.022399:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135968.022418:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202eb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718461 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022481:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202ebc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022495:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202ebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022505:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202ebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022533:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202ec3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022540:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022545:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022634:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022643:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022650:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787135968.022805:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787135968.022898:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787135968.022904:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787135968.022925:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022935:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022943:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202ebc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022950:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202ebc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022979:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202ebc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022985:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135968.022989:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202ebc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.022998:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202ebc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.023010:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:0.0:1787135968.023013:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135968.023017:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202ebc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.023024:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202ebc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.023037:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.023044:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202ec3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.023104:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.023109:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135968.023113:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.023136:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202ec3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.023145:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e98494a1500) 00010000:00010000:0.0:1787135968.023147:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135968.023150:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202ec3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.023156:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202ec3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.023185:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202eb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718461 expref: 46 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.023196:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718461 expref: 45 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.023203:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135968.023205:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787135968.023208:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896200, rc 0) 00000100:00100000:0.0:1787135968.023264:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+45:11445:x1873947595447296:12345-192.168.203.38@tcp:101:stat.0 Request processed in 892us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135968.023272:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:2.0:1787135968.120329:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135968.120483:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595447552 00000100:00100000:0.0:1787135968.120502:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595447552 00000100:00100000:0.0:1787135968.120561:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:0.0:1787135968.120571:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+45:11455:x1873947595447552:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1787135968.120624:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135968.120644:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202ed1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718468 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135968.120751:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787135968.120860:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202ed1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718468 expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.120874:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:0.0:1787135968.120878:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787135968.120883:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f202ed1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718468 expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.120897:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896a00, rc 0) 00000100:00100000:0.0:1787135968.121372:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+46:11455:x1873947595447552:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 797us (1048us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787135968.121381:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 160 00000100:00100000:2.0:1787135968.126561:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135968.126661:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595447808 00000100:00100000:1.0:1787135968.126671:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595447808 00000100:00100000:1.0:1787135968.126726:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:1.0:1787135968.126736:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842acec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+46:11455:x1873947595447808:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1787135968.127006:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842acec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+47:11455:x1873947595447808:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 270us (451us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1787135968.127014:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:1.0:1787135968.230663:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135968.230747:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595448064 00000100:00100000:2.0:1787135968.230757:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595448064 00000100:00100000:2.0:1787135968.230825:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:2.0:1787135968.230835:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+47:11461:x1873947595448064:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1787135968.230859:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135968.230891:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202edf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71846f expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.230999:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.231014:0:7623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718461 expref: 48 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.231024:0:7623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.231084:0:7623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718461 expref: 48 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.231096:0:7623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718461 expref: 48 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135968.231108:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616420224:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135968.231198:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787135968.248396:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616420224:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135968.248426:0:7623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135968.249274:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135968.249544:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595448192 00000100:00100000:2.0:1787135968.249552:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595448192 00010000:00010000:2.0:1787135968.249596:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718461 expref: 49 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135968.249646:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:2.0:1787135968.249655:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+49:2359:x1873947595448192:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135968.249668:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135968.249675:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718461 expref: 49 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.249688:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718461 expref: 49 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.249711:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f202eca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718461 expref: 49 pid: 5822 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.249726:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:2.0:1787135968.249731:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.249741:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.249748:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.249783:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135968.249832:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+48:2359:x1873947595448192:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 178us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135968.249844:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00010000:00010000:0.0:1787135968.249909:0:7623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.249918:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135968.249945:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787135968.250118:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f202edf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71846f expref: 49 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.250134:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71846f expref: 48 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.250150:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135968.250152:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787135968.250155:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7400, rc 0) 00000100:00100000:0.0:1787135968.250186:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+48:11461:x1873947595448064:12345-192.168.203.38@tcp:101:bash.0 Request processed in 19352us (19532us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787135968.250193:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 161 00000100:00100000:0.0:1787135968.253191:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135968.253269:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595448448 00000100:00100000:2.0:1787135968.253291:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595448448 00000100:00100000:2.0:1787135968.253348:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 162 00000100:00100000:2.0:1787135968.253358:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+48:11461:x1873947595448448:12345-192.168.203.38@tcp:36:bash.0 00010000:00010000:2.0:1787135968.253630:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ef4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.253648:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.253658:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787135968.253709:0:5823:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1787135968.253733:0:5823:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000009a444668 reply state 0000000032942377 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135968.253742:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787135968.253832:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+51:11461:x1873947595448448:12345-192.168.203.38@tcp:36:bash.0 Request processed in 475us (649us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1787135968.253839:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 162 00000020:00080000:2.0:1787135968.253843:0:5823:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787135968.258433:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.258451:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ef4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.258459:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.258465:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135968.258470:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ef4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.258477:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ef4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.258502:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135968.258506:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135968.258511:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ef4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.258517:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f202ef4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135968.275557:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135968.276117:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595448576 00000100:00100000:2.0:1787135968.276126:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595448576 00000100:00100000:2.0:1787135968.276174:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 163 00000100:00100000:2.0:1787135968.276184:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+50:11461:x1873947595448576:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1787135968.276207:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135968.276228:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202efb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718476 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.276321:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202f02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.276348:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71846f expref: 51 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.276357:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202f02 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.276390:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71846f expref: 51 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.276405:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71846f expref: 51 pid: 7623 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135968.276420:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616420352:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135968.276502:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787135968.282227:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135968.282695:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595448704 00000100:00100000:3.0:1787135968.282705:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595448704 00010000:00010000:3.0:1787135968.282747:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71846f expref: 52 pid: 7623 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135968.282817:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:3.0:1787135968.282827:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:2359:x1873947595448704:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787135968.282841:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135968.282848:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71846f expref: 52 pid: 7623 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.282861:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71846f expref: 52 pid: 7623 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.282882:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:3.0:1787135968.282886:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202f02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.282895:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.282901:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202f02 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.282922:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135968.282994:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:2359:x1873947595448704:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 168us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135968.283002:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00010000:00010000:2.0:1787135968.283810:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202ee6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71846f expref: 51 pid: 7623 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135968.283830:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616420352:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135968.283850:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.283860:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.283865:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135968.283905:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1787135968.283920:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135968.283956:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.283987:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202efb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718476 expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.284003:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718476 expref: 50 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.284011:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:2.0:1787135968.284014:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787135968.284017:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6c00, rc 0) 00000100:00100000:2.0:1787135968.284113:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+50:11461:x1873947595448576:12345-192.168.203.38@tcp:101:bash.0 Request processed in 7930us (8566us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135968.284121:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 163 00000100:00100000:1.0:1787135968.287948:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135968.288040:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595448960 00000100:00100000:0.0:1787135968.288083:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595448960 00000100:00100000:0.0:1787135968.288135:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:0.0:1787135968.288146:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+50:11461:x1873947595448960:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:0.0:1787135968.288377:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+51:11461:x1873947595448960:12345-192.168.203.38@tcp:35:bash.0 Request processed in 232us (447us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1787135968.288385:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00010000:00010000:1.0:1787135968.359409:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135968.374664:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135968.374755:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595449216 00000100:00100000:2.0:1787135968.374765:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595449216 00000100:00100000:2.0:1787135968.374841:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 164 00000100:00100000:2.0:1787135968.374852:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+51:11471:x1873947595449216:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135968.374876:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135968.374895:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202f09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71847d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135968.375023:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787135968.375165:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202f09 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71847d expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.375179:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:2.0:1787135968.375194:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787135968.375201:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202f09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71847d expref: 53 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.375215:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7000, rc 0) 00000100:00100000:2.0:1787135968.375283:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:11471:x1873947595449216:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 432us (627us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1787135968.375291:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 164 00000100:00100000:1.0:1787135968.378637:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135968.378784:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595449344 00000100:00100000:0.0:1787135968.378794:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595449344 00000100:00100000:0.0:1787135968.378849:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 165 00000100:00100000:0.0:1787135968.378859:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:11471:x1873947595449344:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:0.0:1787135968.378929:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202f17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.378955:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202f17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.378967:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202f17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.378982:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.378989:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.378996:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379145:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379155:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379161:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787135968.379201:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379213:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202f17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379220:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202f17 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379229:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202f17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379235:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135968.379250:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202f17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379258:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202f17 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379269:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:0.0:1787135968.379273:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135968.379278:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202f17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379291:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f202f17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379307:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379313:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379320:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379325:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135968.379329:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379336:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379343:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e98494a1500) 00010000:00010000:0.0:1787135968.379347:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135968.379350:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379356:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379371:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379378:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379390:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379396:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135968.379399:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379405:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379413:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135968.379415:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135968.379418:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.379425:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135968.379490:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:11471:x1873947595449344:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 631us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135968.379499:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 165 00000100:00100000:1.0:1787135968.382694:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135968.382765:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595449600 00000100:00100000:0.0:1787135968.382785:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595449600 00000100:00100000:0.0:1787135968.382844:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:0.0:1787135968.382854:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:11471:x1873947595449600:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:0.0:1787135968.383283:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:11471:x1873947595449600:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 430us (598us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787135968.383292:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:1.0:1787135968.415231:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135968.415364:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595449856 00000100:00100000:2.0:1787135968.415374:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595449856 00000100:00100000:2.0:1787135968.415433:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 166 00000100:00100000:2.0:1787135968.415445:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+53:11474:x1873947595449856:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135968.415470:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135968.415490:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202f2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718484 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415561:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202f33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415576:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202f33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415586:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202f33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415600:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202f3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415607:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415631:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415754:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202f41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415764:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415786:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135968.415796:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787135968.415888:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202f33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415896:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202f33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415903:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202f33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415909:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135968.415914:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202f33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415922:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202f33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415945:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:2.0:1787135968.415949:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135968.415961:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202f33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415967:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f202f33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415982:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202f3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415988:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202f3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415994:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202f3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.415999:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135968.416003:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202f3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.416009:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202f3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.416017:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e98532d1700) 00010000:00010000:2.0:1787135968.416019:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135968.416021:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202f3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.416027:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f202f3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.416121:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202f2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718484 expref: 56 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.416150:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718484 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.416158:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:2.0:1787135968.416160:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787135968.416163:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7800, rc 0) 00000100:00100000:2.0:1787135968.416224:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:11474:x1873947595449856:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 781us (1002us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1787135968.416231:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 166 00000100:00100000:1.0:1787135968.429266:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135968.429307:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135968.429392:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595449984 00000100:00100000:0.0:1787135968.429402:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595449984 00000100:00100000:0.0:1787135968.429465:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 167 00000100:00100000:0.0:1787135968.429475:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:11474:x1873947595449984:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:0.0:1787135968.429535:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.429551:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.429563:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.429603:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.429611:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.429618:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.429623:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135968.429626:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.429632:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.429643:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135968.429646:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787135968.429651:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.429671:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135968.429746:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:11474:x1873947595449984:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 272us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135968.429753:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 167 00000100:00100000:2.0:1787135968.430558:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595450112 00000100:00100000:2.0:1787135968.430565:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595450112 00000100:00100000:2.0:1787135968.430619:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:2.0:1787135968.430628:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:2360:x1873947595450112:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135968.430640:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135968.430657:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202f41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718484 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.430670:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:2.0:1787135968.430674:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135968.430711:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:2360:x1873947595450112:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 84us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135968.430718:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:1.0:1787135968.434005:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135968.434210:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595450368 00000100:00100000:2.0:1787135968.434220:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595450368 00000100:00100000:2.0:1787135968.434276:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:2.0:1787135968.434297:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:11474:x1873947595450368:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1787135968.434510:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:11474:x1873947595450368:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 214us (514us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1787135968.434517:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:1.0:1787135968.597110:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135968.597329:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595450624 00000100:00100000:2.0:1787135968.597339:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595450624 00000100:00100000:2.0:1787135968.597441:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 168 00000100:00100000:2.0:1787135968.597452:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:11492:x1873947595450624:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:2.0:1787135968.597474:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135968.597501:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202f56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71848b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.597597:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202f5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.597611:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202f5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.597622:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202f5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135968.597633:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787135968.597754:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f202f56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71848b expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.597785:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202f5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71848b expref: 57 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135968.597811:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:2.0:1787135968.597814:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787135968.597818:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7000, rc 0) 00000100:00100000:2.0:1787135968.597879:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:11492:x1873947595450624:12345-192.168.203.38@tcp:101:cat.0 Request processed in 429us (777us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787135968.597885:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 168 00000100:00100000:1.0:1787135968.634290:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135968.634379:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595450752 00000100:00100000:0.0:1787135968.634389:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595450752 00000100:00100000:0.0:1787135968.634479:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 169 00000100:00100000:0.0:1787135968.634491:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:11493:x1873947595450752:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:0.0:1787135968.634514:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135968.634532:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718492 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.634606:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.634619:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.634631:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135968.634686:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787135968.634700:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787135968.634724:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.634749:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718492 expref: 59 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.635107:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718492 expref: 58 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.635117:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:0.0:1787135968.635120:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787135968.635124:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897e00, rc 0) 00000100:00100000:0.0:1787135968.635189:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11493:x1873947595450752:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 700us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135968.635197:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 169 00000100:00100000:1.0:1787135968.641948:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135968.642235:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595451136 00000100:00100000:2.0:1787135968.642253:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595451136 00000100:00100000:2.0:1787135968.642333:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:2.0:1787135968.642344:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11493:x1873947595451136:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1787135968.642653:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11493:x1873947595451136:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 310us (896us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787135968.642661:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:1.0:1787135968.644695:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135968.644834:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595451264 00000100:00100000:3.0:1787135968.644844:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595451264 00000100:00100000:3.0:1787135968.644900:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:3.0:1787135968.644910:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11493:x1873947595451264:12345-192.168.203.38@tcp:103:lfs.0 00010000:00010000:3.0:1787135968.644946:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787135968.644970:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f202f02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718476 expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.645002:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f202f5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71848b expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.645015:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840031800/0xf5850c552f202e0d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718437 expref: 57 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.645026:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:3.0:1787135968.645036:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135968.645107:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:11493:x1873947595451264:12345-192.168.203.38@tcp:103:lfs.0 Request processed in 199us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135968.645115:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:1.0:1787135968.646961:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135968.647141:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595451392 00000100:00100000:0.0:1787135968.647150:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595451392 00000100:00100000:0.0:1787135968.647201:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 170 00000100:00100000:0.0:1787135968.647211:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:11493:x1873947595451392:12345-192.168.203.38@tcp:58:lfs.0 00010000:00010000:0.0:1787135968.647308:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f79 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.647323:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135968.647333:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787135968.647511:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1787135968.647579:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:11493:x1873947595451392:12345-192.168.203.38@tcp:58:lfs.0 Request processed in 369us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135968.647587:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 170 00000100:00100000:1.0:1787135968.676315:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135968.676406:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595451520 00000100:00100000:3.0:1787135968.676416:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595451520 00000100:00100000:3.0:1787135968.676474:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 171 00000100:00100000:3.0:1787135968.676484:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:11495:x1873947595451520:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135968.676513:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135968.676532:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f202f80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718499 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676593:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202f87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676608:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202f87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676633:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202f87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676649:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202f8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676657:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676663:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676763:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676772:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676778:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135968.676819:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787135968.676823:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787135968.676840:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676851:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676858:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202f87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676872:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202f87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676878:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676883:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135968.676887:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202f87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676894:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202f87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676905:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:3.0:1787135968.676908:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135968.676912:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202f87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676918:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202f87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676943:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202f8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676950:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202f8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676956:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676961:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e3800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135968.676969:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202f8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676975:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202f8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.676982:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9843179600) 00010000:00010000:3.0:1787135968.676984:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135968.676996:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202f8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.677002:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f202f8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.677035:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f202f80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718499 expref: 58 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.677098:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718499 expref: 57 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135968.677106:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98494a1500) 00010000:00010000:3.0:1787135968.677109:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787135968.677112:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e3400, rc 0) 00000100:00100000:3.0:1787135968.677475:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:11495:x1873947595451520:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 991us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135968.677482:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 171 00010000:00010000:2.0:1787135969.368587:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787135969.560489:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787135969.560499:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787135969.560560:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1787135969.560572:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787135969.560710:0:11666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98533ab100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1873947616420480:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787135969.560805:0:11666:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98604570c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135969.567880:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135969.567915:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595451648 00000100:00100000:1.0:1787135969.567924:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595451648 00000100:00100000:1.0:1787135969.567974:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:1.0:1787135969.567984:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11506:x1873947595451648:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787135969.568014:0:5821:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787135969.568125:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11506:x1873947595451648:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 142us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135969.568133:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 172 00000100:00100000:2.0:1787135969.568440:0:11666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98533ab100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1873947616420480:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787135969.570927:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135969.571117:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595451776 00000100:00100000:1.0:1787135969.571127:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595451776 00000100:00100000:1.0:1787135969.571176:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 173 00000100:00100000:1.0:1787135969.571187:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:11506:x1873947595451776:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787135969.571266:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202f9c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571284:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202f9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571295:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202f9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571309:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202fa3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571327:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571335:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571360:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202faa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571369:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571375:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135969.571409:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787135969.571414:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787135969.571428:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571439:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202f9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571445:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202f9c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571451:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202f9c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571457:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afa00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135969.571462:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202f9c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571476:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202f9c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571489:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9853809600) 00010000:00010000:1.0:1787135969.571492:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135969.571497:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202f9c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571503:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f202f9c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571517:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571522:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571528:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571533:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135969.571536:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571541:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571548:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8e9853809900) 00010000:00010000:1.0:1787135969.571551:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135969.571553:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202fa3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571569:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f202fa3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571583:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202faa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571588:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202faa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571593:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571597:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135969.571599:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202faa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571605:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202faa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571612:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98494a1500) 00010000:00010000:1.0:1787135969.571614:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135969.571617:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202faa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.571621:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f202faa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135969.571702:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:11506:x1873947595451776:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 Request processed in 516us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135969.571709:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 173 00000100:00100000:1.0:1787135969.575241:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135969.575394:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595452032 00000100:00100000:0.0:1787135969.575410:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595452032 00000100:00100000:0.0:1787135969.575466:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 174 00000100:00100000:0.0:1787135969.575477:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98533ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:11506:x1873947595452032:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787135969.575497:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135969.575516:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f202fb1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184a0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.575610:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.575624:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.575635:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135969.575646:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787135969.575744:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.575751:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.575758:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.575763:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135969.575768:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.575776:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.575795:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98494a1500) 00010000:00010000:0.0:1787135969.575798:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787135969.575804:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fb8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.575810:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.575849:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f202fb1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184a0 expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.575859:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9853809600) 00010000:00010000:0.0:1787135969.575862:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787135969.575866:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f202fb1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184a0 expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.575875:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897200, rc 0) 00000100:00100000:0.0:1787135969.575934:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98533ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11506:x1873947595452032:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 459us (712us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1787135969.575942:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 174 00000100:00100000:1.0:1787135969.588419:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135969.588470:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595452160 00000100:00100000:1.0:1787135969.588479:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595452160 00000100:00100000:1.0:1787135969.588528:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 175 00000100:00100000:1.0:1787135969.588538:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11506:x1873947595452160:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787135969.588571:0:5822:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787135969.588745:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876cad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11506:x1873947595452160:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 128us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135969.588754:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 175 00000040:00080000:2.0:1787135969.590660:0:12435:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787135969.591756:0:12435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787135969.591828:0:12435:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1787135969.591834:0:12435:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787135969.594877:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135969.596063:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595452416 00000100:00100000:0.0:1787135969.596094:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595452416 00000100:00100000:0.0:1787135969.596170:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 176 00000100:00100000:0.0:1787135969.596181:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9874978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11506:x1873947595452416:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787135969.596199:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135969.596202:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787135969.596225:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f202f72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718492 expref: 58 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.596289:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:0.0:1787135969.596294:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787135969.596306:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f202fc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184a7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787135969.598570:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787135969.598805:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.598821:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.598830:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.598889:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f202fc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184a7 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.598907:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184a7 expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.598946:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98494a1200) 00010000:00010000:0.0:1787135969.598949:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787135969.598952:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897600, rc 0) 00000100:00100000:0.0:1787135969.599023:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9874978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11506:x1873947595452416:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 2843us (4156us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787135969.599031:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 176 00000100:00100000:1.0:1787135969.603421:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135969.603499:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595452672 00000100:00100000:3.0:1787135969.603509:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595452672 00000100:00100000:3.0:1787135969.603587:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 177 00000100:00100000:3.0:1787135969.603597:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11506:x1873947595452672:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787135969.603655:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135969.603680:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f202fcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184a7 expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603697:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98494a1200) 00010000:00010000:3.0:1787135969.603706:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787135969.603726:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f202fdb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603750:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f202fdb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603761:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f202fdb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603842:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202fe2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc9a4e741 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603851:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9a4e741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603859:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9a4e741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603928:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f202fdb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603936:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f202fdb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603943:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f202fdb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603957:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135969.603962:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f202fdb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603969:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f202fdb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603978:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:3.0:1787135969.603981:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135969.603984:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f202fdb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.603990:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f202fdb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.604001:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9a4e741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.604008:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202fe2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9a4e741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.604014:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9a4e741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.604020:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135969.604023:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202fe2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9a4e741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.604029:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202fe2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc9a4e741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.604067:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc9a4e741 (ffff8e9843179600) 00010000:00010000:3.0:1787135969.604070:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135969.604073:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202fe2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc9a4e741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.604079:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202fe2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc9a4e741 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135969.604158:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11506:x1873947595452672:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 562us (745us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787135969.604166:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 177 00000100:00100000:2.0:1787135969.606477:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135969.606713:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595452800 00000100:00100000:0.0:1787135969.606722:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595452800 00000100:00100000:0.0:1787135969.606788:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:0.0:1787135969.606798:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11506:x1873947595452800:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787135969.606816:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135969.606834:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202fe9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184ae expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.606867:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202ff0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.606882:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.606894:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202ff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.607450:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ae expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.607464:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ae expref: 59 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.607472:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98494a1900) 00010000:00010000:0.0:1787135969.607475:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787135969.607478:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896000, rc 0) 00000100:00100000:0.0:1787135969.607538:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987482a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11506:x1873947595452800:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 742us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135969.607544:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 178 00000100:00100000:0.0:1787135969.632786:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135969.632824:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595453056 00000100:00100000:0.0:1787135969.632833:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595453056 00000100:00100000:0.0:1787135969.632880:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 179 00000100:00100000:0.0:1787135969.632890:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11506:x1873947595453056:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787135969.632962:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202ff7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.632978:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.632988:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787135969.633271:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1787135969.633281:0:7623:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329576232021ns, next at 330576229486ns, rc = 0 00000004:00010000:0.0:1787135969.633814:0:7623:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000001e91c6a6 reply state 00000000c84c1db2 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135969.633827:0:7623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787135969.633928:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:11506:x1873947595453056:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 1038us (1147us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787135969.633936:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 179 00010000:00010000:3.0:1787135969.642248:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202ff7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.642265:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202ff7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.642274:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202ff7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.642281:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135969.642287:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202ff7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.642296:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202ff7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.642314:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98494a1900) 00010000:00010000:3.0:1787135969.642318:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787135969.642322:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202ff7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.642337:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897000/0xf5850c552f202ff7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135969.642737:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135969.642956:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595453184 00000100:00100000:3.0:1787135969.642966:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595453184 00000100:00100000:3.0:1787135969.643022:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:3.0:1787135969.643033:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:11506:x1873947595453184:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787135969.643071:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135969.643088:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202ffe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184b5 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.643142:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202ffe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184b5 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.643155:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202ffe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184b5 expref: 61 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.643176:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98494a1900) 00010000:00010000:3.0:1787135969.643179:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135969.643183:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e2800, rc 0) 00000100:00100000:3.0:1787135969.643253:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:11506:x1873947595453184:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 222us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135969.643260:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 180 00000100:00100000:2.0:1787135969.655368:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135969.655452:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595453312 00000100:00100000:1.0:1787135969.655463:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595453312 00000100:00100000:1.0:1787135969.655560:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:1.0:1787135969.655572:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595453312:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787135969.655966:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2361:x1873947595453312:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 395us (605us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1787135969.655974:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00080000:2.0:1787135969.656136:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787135969.664404:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135969.664472:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595453568 00000100:00100000:0.0:1787135969.664481:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595453568 00000100:00100000:0.0:1787135969.664546:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:0.0:1787135969.664557:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:11506:x1873947595453568:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787135969.664782:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+62:11506:x1873947595453568:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 227us (387us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1787135969.664802:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:1.0:1787135969.668633:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135969.668688:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595453824 00000100:00100000:2.0:1787135969.668698:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595453824 00000100:00100000:2.0:1787135969.668851:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:2.0:1787135969.668864:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+62:11506:x1873947595453824:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787135969.668976:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+62:11506:x1873947595453824:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 115us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135969.668984:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 181 00000100:00100000:3.0:1787135969.672624:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135969.672675:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595453952 00000100:00100000:2.0:1787135969.672685:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595453952 00000100:00100000:2.0:1787135969.672755:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:2.0:1787135969.672767:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+62:11506:x1873947595453952:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787135969.672788:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135969.672808:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203005 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184bc expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.672876:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20300c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.672891:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20300c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.672965:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20300c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135969.673006:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135969.673024:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20300c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.673075:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203005 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184bc expref: 64 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.673107:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20300c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184bc expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.673116:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98494a1900) 00010000:00010000:2.0:1787135969.673119:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787135969.673122:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7000, rc 0) 00000100:00100000:2.0:1787135969.673185:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+63:11506:x1873947595453952:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 421us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135969.673192:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 182 00000100:00100000:1.0:1787135969.680444:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135969.680533:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595454080 00000100:00100000:3.0:1787135969.680540:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595454080 00000100:00100000:3.0:1787135969.680606:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:3.0:1787135969.680626:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2359:x1873947595454080:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787135969.680642:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135969.680656:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d410559/0xf5850c552f203013 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184c3 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787135969.680676:0:6673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8587e1, blocks: 0x1 00010000:00010000:3.0:1787135969.680691:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=329s v=(0 0) 00010000:00010000:3.0:1787135969.680702:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787135969.680709:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d410559/0xf5850c552f203013 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184c3 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.680721:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006d410559/0xf5850c552f203013 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184c3 expref: 8 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.680732:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e2200, rc 0) 00000100:00100000:3.0:1787135969.680795:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2359:x1873947595454080:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 169us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135969.680802:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:1.0:1787135969.683149:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135969.683252:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595454336 00000100:00100000:3.0:1787135969.683261:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595454336 00000100:00100000:3.0:1787135969.683308:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 183 00000100:00100000:3.0:1787135969.683319:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+63:11506:x1873947595454336:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787135969.684084:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+63:11506:x1873947595454336:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 763us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135969.684096:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 183 00000100:00100000:3.0:1787135969.689035:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135969.691851:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595454464 00000100:00100000:1.0:1787135969.691880:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595454464 00000100:00100000:1.0:1787135969.692437:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:1.0:1787135969.692450:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:11506:x1873947595454464:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787135969.692477:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135969.692496:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184ca expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.692525:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d410559/0xf5850c552f203013 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184c3 expref: 9 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.692534:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787135969.692538:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787135969.692543:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ca expref: 9 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.692574:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d410559/0xf5850c552f203013 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184c3 expref: 9 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.692589:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d410559/0xf5850c552f203013 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184c3 expref: 9 pid: 6673 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135969.692604:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6674:1873947616420608:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787135969.692713:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9860457180 going to sleep for 11 seconds 00000100:00100000:1.0:1787135969.697418:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6674:1873947616420608:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787135969.697454:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ca expref: 9 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.697474:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533af800, rc 0) 00000100:00100000:0.0:1787135969.697523:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135969.697544:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:11506:x1873947595454464:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 5095us (8515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135969.697553:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:3.0:1787135969.697831:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595454592 00000100:00100000:3.0:1787135969.697838:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595454592 00010000:00010000:3.0:1787135969.697868:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d410559/0xf5850c552f203013 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184c3 expref: 9 pid: 6673 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135969.697904:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:3.0:1787135969.697913:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2359:x1873947595454592:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787135969.697925:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135969.697946:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d410559/0xf5850c552f203013 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184c3 expref: 9 pid: 6673 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.697959:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d410559/0xf5850c552f203013 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184c3 expref: 9 pid: 6673 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.697982:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d410559/0xf5850c552f203013 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184c3 expref: 9 pid: 6673 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.697996:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787135969.698000:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787135969.698008:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ca expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.698018:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ca expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.698304:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ca expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135969.698320:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873947616420736:192.168.203.38@tcp:105: 00000100:00100000:3.0:1787135969.698379:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457db840 going to sleep for 11 seconds 00000100:00100000:3.0:1787135969.699647:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5806:1873947616420736:192.168.203.38@tcp:105: 00010000:00010000:3.0:1787135969.699667:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135969.699713:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2359:x1873947595454592:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 1800us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135969.699723:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:1.0:1787135969.709386:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135969.709421:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595454720 00000100:00100000:3.0:1787135969.709430:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595454720 00002000:00100000:3.0:1787135969.709471:0:6679:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e974499c000 x1873947595454720/t0(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:395/0 lens 504/0 e 0 to 0 dl 1787135980 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787135969.709480:0:6679:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e974499c000 with x1873947595454720 ext(0->8) 00002000:00010000:3.0:1787135969.709484:0:6679:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e974499c000 00000100:00100000:3.0:1787135969.709512:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1787135969.709518:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595454720:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787135969.710250:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:2360:x1873947595454720:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 Request processed in 729us (871us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787135969.710260:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00002000:00100000:3.0:1787135969.710267:0:6679:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e974499c000 x1873947595454720/t4294967314(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:395/0 lens 504/448 e 0 to 0 dl 1787135980 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787135969.710288:0:6679:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e974499c000 with x1873947595454720 ext(0->8) 00002000:00010000:3.0:1787135969.710293:0:6679:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e974499c000 00000100:00100000:3.0:1787135969.711761:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135969.711829:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595454848 00000100:00100000:1.0:1787135969.711836:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595454848 00000100:00100000:1.0:1787135969.711881:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 184 00000100:00100000:1.0:1787135969.711890:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+63:11506:x1873947595454848:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787135969.742899:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1787135969.742916:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:3.0:1787135969.742972:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1787135969.742993:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e9745285600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1787135969.742998:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e987c130f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e97452853c0 00000020:00080000:3.0:1787135969.743001:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e987c130c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e9874780800 00000100:00100000:1.0:1787135969.743087:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:11506:x1873947595454848:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 Request processed in 31193us (31326us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135969.743097:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 184 00000020:00080000:2.0:1787135969.743269:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1787135969.743270:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974754ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616420864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787135969.743317:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1787135969.743412:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787135969.743569:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616420864 00000100:00100000:1.0:1787135969.743576:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616420864 00000100:00100000:1.0:1787135969.743627:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787135969.743636:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616420864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787135969.743753:0:11994:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787135969.743756:0:11994:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787135969 00002000:00010000:1.0:1787135969.743759:0:11994:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787135969.743761:0:11994:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787135969 -> 1787135969 00002000:00010000:1.0:1787135969.743763:0:11994:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787135969.743792:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1873947616420864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 157us (474us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787135969.743798:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787135969.743817:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616420992:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787135969.743842:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135969.743939:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616420992 00000100:00100000:0.0:1787135969.743944:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616420992 00000004:00080000:3.0:1787135969.743972:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e974754ca80/2, rc 0, transno 4294967315 00000100:00100000:0.0:1787135969.743973:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787135969.743977:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974754ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616420864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787135969.743980:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1873947616420992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787135969.743993:0:6672:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1787135969.744017:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8587de, atime: 0x6a8587de, ctime: 0x6a8587de, blocks: 0x1 00010000:00010000:0.0:1787135969.744025:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f203021 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.744042:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:0.0:1787135969.744069:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135969.744077:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f203021 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.744093:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f203021 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787135969.744102:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787135969.744103:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f203021 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787135969.744107:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787135969.744110:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f203021 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.744127:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787135969.744169:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787135969.744179:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f203021 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.744187:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787135969.744192:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f203021 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.744200:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f203021 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.744216:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f203021 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.744223:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f203021 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.744250:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135969.744251:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135969.744253:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135969.744543:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1873947616420992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 562us (698us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787135969.744550:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1787135969.744570:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e987c18ed80/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787135969.744577:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616420992:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787135969.746827:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135969.746896:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595454976 00000100:00100000:1.0:1787135969.746905:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595454976 00000100:00100000:1.0:1787135969.746988:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:1.0:1787135969.746997:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:2360:x1873947595454976:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787135969.763812:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1787135969.763826:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1787135969.763832:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1787135969.763988:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595454976:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 Request processed in 16987us (17163us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135969.764000:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:3.0:1787135969.768532:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135969.768647:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595455232 00000100:00100000:2.0:1787135969.768655:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595455232 00000100:00100000:2.0:1787135969.768697:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 185 00000100:00100000:2.0:1787135969.768704:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:11506:x1873947595455232:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787135969.768744:0:7623:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135969.768769:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20300c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184bc expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.768787:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98494a1900) 00010000:00010000:2.0:1787135969.768792:0:7623:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135969.768816:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203028 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.768829:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.768854:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787135969.769379:0:7623:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000018e7b2e5 reply state 00000000e37e6672 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135969.769389:0:7623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787135969.769518:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:11506:x1873947595455232:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 812us (990us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1787135969.769526:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 185 00000100:00100000:0.0:1787135969.772292:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:1.0:1787135969.772453:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.772483:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203028 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.772491:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135969.772492:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595455360 00010000:00010000:1.0:1787135969.772496:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6e00 already unused, calling callback (ffffffffc20304f0) 00000100:00100000:3.0:1787135969.772500:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595455360 00010000:00010000:1.0:1787135969.772501:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.772508:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203028 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.772521:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98494a1900) 00010000:00010000:1.0:1787135969.772524:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135969.772528:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203028 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135969.772534:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203028 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135969.772544:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:3.0:1787135969.772554:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2359:x1873947595455360:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787135969.772760:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787135969.772763:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787135969 -> 1787135968 00002000:00010000:3.0:1787135969.772765:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787135966 00002000:00010000:3.0:1787135969.772766:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787135969 -> 1787135968 00002000:00010000:3.0:1787135969.772768:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787135969.772808:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2359:x1873947595455360:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 256us (524us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1787135969.772816:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:3.0:1787135969.775248:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135969.776778:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595455616 00000100:00100000:2.0:1787135969.776790:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595455616 00000100:00100000:2.0:1787135969.776861:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:2.0:1787135969.776872:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:11506:x1873947595455616:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787135969.776936:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.776953:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202ff0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ae expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.776962:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.776996:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ae expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.777010:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202ff0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ae expref: 18 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135969.777044:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974754d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1873947616421120:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135969.777152:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457c2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787135969.779145:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974754d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1873947616421120:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135969.779168:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135969.779416:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135969.779459:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595455744 00000100:00100000:2.0:1787135969.779465:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595455744 00010000:00010000:2.0:1787135969.779498:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202ff0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ae expref: 19 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135969.779575:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:2.0:1787135969.779585:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:2360:x1873947595455744:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135969.779666:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135969.779675:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202ff0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ae expref: 19 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.779687:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202ff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ae expref: 19 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.779707:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f202ff0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ae expref: 19 pid: 5821 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.779721:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98494a1900) 00010000:00010000:2.0:1787135969.779725:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.779744:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.779752:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.779773:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787135969.779804:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.779815:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135969.779824:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:2360:x1873947595455744:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 238us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135969.779833:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 71 00010000:00010000:3.0:1787135969.779845:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.779854:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.779862:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.779868:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135969.779873:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.779881:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.779899:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98494a1900) 00010000:00010000:3.0:1787135969.779902:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787135969.779906:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.779913:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20302f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135969.779969:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+17:11506:x1873947595455616:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 Request processed in 3099us (5401us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787135969.779978:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 186 00000100:00100000:3.0:1787135969.781010:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135969.781076:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595455872 00000100:00100000:0.0:1787135969.781083:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595455872 00000100:00100000:0.0:1787135969.781127:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:0.0:1787135969.781136:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595455872:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787135969.781170:0:6673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.781187:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ca expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.781195:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135969.781200:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787135969.781204:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.781291:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ca expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.781306:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ca expref: 8 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135969.781334:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1873947616421248:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135969.781391:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aef9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135969.785852:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135969.785921:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1873947616421248:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787135969.785956:0:6673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135969.785994:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595456000 00000100:00100000:3.0:1787135969.786000:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595456000 00010000:00010000:3.0:1787135969.786034:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ca expref: 9 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135969.786151:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:0.0:1787135969.786162:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2359:x1873947595456000:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135969.786178:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135969.786201:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ca expref: 9 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.786216:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ca expref: 9 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.786249:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fba9a678/0xf5850c552f20301a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ca expref: 9 pid: 6674 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.786264:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787135969.786268:0:5806:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787135969.786274:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.786302:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.786333:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135969.786391:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2359:x1873947595456000:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 230us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135969.786399:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00010000:00010000:3.0:1787135969.787570:0:6673:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.787648:0:6673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.787735:0:6673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.787745:0:6673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.787764:0:6673:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.787772:0:6673:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896a00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787135969.787776:0:6673:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.787785:0:6673:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.787800:0:6673:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.787808:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a6f2a45/0xf5850c552f203036 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135969.787948:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595455872:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 Request processed in 6809us (6936us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135969.787957:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:1.0:1787135969.790490:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135969.790929:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595456256 00000100:00100000:3.0:1787135969.790939:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595456256 00000100:00100000:3.0:1787135969.790991:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 187 00000100:00100000:3.0:1787135969.791001:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+17:11506:x1873947595456256:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787135969.791108:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f20303d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.791135:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f20303d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.791723:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f20303d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.791931:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.791941:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202ffe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184b5 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.791947:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.791973:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202ffe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184b5 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.791983:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202ffe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184b5 expref: 18 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135969.791993:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616421376:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135969.792079:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98749eacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135969.793897:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616421376:192.168.203.38@tcp:104: 00010000:00010000:3.0:1787135969.793924:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135969.795704:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135969.795968:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595456384 00000100:00100000:0.0:1787135969.795976:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595456384 00010000:00010000:0.0:1787135969.796009:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202ffe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184b5 expref: 19 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135969.796076:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:0.0:1787135969.796088:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:2360:x1873947595456384:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135969.796161:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135969.796170:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202ffe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184b5 expref: 19 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.796184:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202ffe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184b5 expref: 19 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.796205:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f202ffe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184b5 expref: 19 pid: 5823 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.796221:0:7612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98494a1900) 00010000:00010000:0.0:1787135969.796249:0:7612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.796258:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.796265:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.796291:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135969.796335:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+18:2360:x1873947595456384:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 249us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135969.796344:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00010000:00010000:3.0:1787135969.796353:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.796365:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787135969.796552:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1787135969.796688:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1787135969.796718:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1787135969.796775:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5822:1873947616421504:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787135969.796821:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135969.796884:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616421504 00000100:00100000:2.0:1787135969.796891:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616421504 00000100:00100000:3.0:1787135969.796925:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98749ea540 going to sleep for 11 seconds 00000100:00100000:2.0:1787135969.796942:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787135969.796950:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1873947616421504:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787135969.797035:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1873947616421504:12345-0@lo:1000:mdt00_001.0 Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135969.797042:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787135969.797723:0:5822:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1787135969.797731:0:5822:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e974754ca80, transno 4294967315 00000100:00100000:3.0:1787135969.797746:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5822:1873947616421504:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787135969.798203:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1787135969.798272:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5822:1873947616421632:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787135969.798309:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135969.798339:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98749eacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135969.798393:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616421632 00000100:00100000:2.0:1787135969.798399:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616421632 00000100:00100000:2.0:1787135969.798438:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787135969.798446:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5822:x1873947616421632:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787135969.798704:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1873947616421632:12345-0@lo:1000:mdt00_001.0 Request processed in 260us (394us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1787135969.798710:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787135969.798765:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5822:1873947616421632:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787135969.798786:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798793:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798798:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798802:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e3800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135969.798805:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798816:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798828:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98494a1900) 00010000:00010000:3.0:1787135969.798829:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135969.798832:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798836:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f203044 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798857:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f79 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798861:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f79 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798865:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798868:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135969.798869:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f79 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798872:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f79 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798876:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98494a1500) 00010000:00010000:3.0:1787135969.798877:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135969.798879:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f79 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798888:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897a00/0xf5850c552f202f79 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798903:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798913:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718499 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798919:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798936:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718499 expref: 21 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.798945:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718499 expref: 21 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135969.798952:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616421760:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135969.799005:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98749eacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135969.802745:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135969.802869:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616421760:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135969.802898:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595456512 00010000:00010000:3.0:1787135969.802899:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135969.802905:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595456512 00010000:00010000:0.0:1787135969.802937:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718499 expref: 22 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135969.802966:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 74 00000100:00100000:0.0:1787135969.802973:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:2359:x1873947595456512:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135969.802984:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135969.802989:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718499 expref: 22 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.802997:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718499 expref: 22 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.803014:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f202f95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718499 expref: 22 pid: 5822 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.803044:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98494a1500) 00010000:00010000:0.0:1787135969.803389:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.803399:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.803407:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.803435:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787135969.803665:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803673:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803692:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803700:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803706:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803712:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135969.803716:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803723:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803731:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98494a1500) 00010000:00010000:3.0:1787135969.803734:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135969.803737:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803742:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f20304b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803753:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f20303d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803760:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f20303d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803778:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f20303d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803790:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135969.803793:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f20303d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803799:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f20303d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803806:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98494a1500) 00010000:00010000:3.0:1787135969.803808:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787135969.803811:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f20303d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135969.803816:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f20303d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135969.804004:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:2359:x1873947595456512:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 507us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135969.804014:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 74 00000040:00080000:2.0:1787135969.804095:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787135969.804100:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787135969.804510:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787135969.804524:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787135969.805202:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:11506:x1873947595456256:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 14199us (14732us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1787135969.805212:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 187 00000020:00080000:2.0:1787135969.805216:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787135969.806733:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135969.806877:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595456768 00000100:00100000:0.0:1787135969.806886:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595456768 00000100:00100000:0.0:1787135969.807018:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:0.0:1787135969.807029:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842acf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:11506:x1873947595456768:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787135969.807767:0:5825:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787135969.807864:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1787135969.807904:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203052 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.807921:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.807931:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.807939:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203052 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.807946:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203052 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.807952:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135969.807974:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787135969.808023:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787135969.808029:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203052 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.808035:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787135969.808039:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203052 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.808044:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135969.808077:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842acf450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:11506:x1873947595456768:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 1047us (1347us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787135969.808086:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000020:00080000:2.0:1787135969.808091:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787135969.808142:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e98532d1600) 00010000:00010000:0.0:1787135969.808145:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787135969.808150:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203052 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.808155:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203052 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135969.808171:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135969.808173:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135969.808175:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135970.394291:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787135970.849304:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787135970.850202:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787135970.850736:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787135970.850744:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787135971.173713:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135971.173754:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135971.173788:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135971.173834:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135971.173861:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135971.173889:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595457280 00000100:00100000:1.0:1787135971.173898:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595457280 00000100:00100000:1.0:1787135971.173957:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595457152 00000100:00100000:1.0:1787135971.173960:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595457152 00000100:00100000:1.0:1787135971.173982:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:1.0:1787135971.173992:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2359:x1873947595457280:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135971.174087:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2359:x1873947595457280:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 96us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135971.174094:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:3.0:1787135971.174270:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595457024 00000100:00100000:3.0:1787135971.174275:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595457024 00000100:00100000:3.0:1787135971.174306:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595457408 00000100:00100000:3.0:1787135971.174320:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595457408 00000100:00100000:3.0:1787135971.174349:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:3.0:1787135971.174356:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:2359:x1873947595457024:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135971.174391:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:2359:x1873947595457024:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 36us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135971.174397:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 148 00000100:00100000:3.0:1787135971.174411:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:3.0:1787135971.174417:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595457408:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135971.174437:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2360:x1873947595457408:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 20us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135971.174449:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 149 00000100:00100000:2.0:1787135971.174516:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595456896 00000100:00100000:2.0:1787135971.174526:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595456896 00000100:00100000:2.0:1787135971.174552:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 292 00000100:00100000:2.0:1787135971.174559:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595456896:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135971.174583:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ccb52158-7d35-4065-a26d-1bb142899404+13:2359:x1873947595456896:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135971.174589:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 292 00000100:00100000:3.0:1787135971.177359:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:3.0:1787135971.177380:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595457152:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135971.177451:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595457152:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 79us (3616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135971.177460:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00080000:1.0:1787135971.178669:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787135971.178677:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787135971.178680:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1787135971.397910:0:12488:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787135971.397918:0:12488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787135971.397951:0:12488:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1787135971.397957:0:12488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1787135971.422197:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787135971.430229:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1787135971.430243:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1787135971.559362:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135971.559443:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595457664 00000100:00100000:3.0:1787135971.559454:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595457664 00000100:00100000:3.0:1787135971.559520:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:3.0:1787135971.559529:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:11525:x1873947595457664:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135971.559549:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135971.559577:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f203059 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184d1 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.559823:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f203060 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.559839:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f203060 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.559849:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f203060 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135971.559860:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787135971.560030:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f203059 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184d1 expref: 25 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.560093:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f203060 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184d1 expref: 24 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.560102:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:3.0:1787135971.560105:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787135971.560108:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e2400, rc 0) 00000100:00100000:3.0:1787135971.560154:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:11525:x1873947595457664:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 626us (800us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787135971.560162:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 188 00000100:00100000:2.0:1787135971.571578:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135971.571755:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595457792 00000100:00100000:1.0:1787135971.571766:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595457792 00000100:00100000:1.0:1787135971.571824:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:1.0:1787135971.571835:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:11525:x1873947595457792:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:1.0:1787135971.571904:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f20306e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572012:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f20306e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572024:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f20306e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572082:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203075 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572091:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572098:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572379:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20307c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572388:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20307c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572395:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20307c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787135971.572431:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20307c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572444:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f20306e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572450:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f20306e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572457:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f20306e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572463:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afc00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135971.572468:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f20306e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572481:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f20306e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572493:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:1.0:1787135971.572496:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135971.572501:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f20306e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572507:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f20306e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572518:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203075 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572524:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203075 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572530:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572535:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afe00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135971.572538:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203075 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572544:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203075 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572549:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9853809500) 00010000:00010000:1.0:1787135971.572552:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135971.572554:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203075 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572670:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203075 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572685:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20307c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572690:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20307c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572696:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20307c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572701:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aec00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135971.572704:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20307c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572710:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20307c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572717:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9853809900) 00010000:00010000:1.0:1787135971.572719:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135971.572722:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20307c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.572728:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20307c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135971.572802:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:11525:x1873947595457792:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 967us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135971.572811:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 189 00000100:00100000:1.0:1787135971.639830:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135971.639893:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595458048 00000100:00100000:3.0:1787135971.639903:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595458048 00000100:00100000:3.0:1787135971.641385:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:3.0:1787135971.641404:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:11528:x1873947595458048:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135971.641423:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135971.641442:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f203083 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184d8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.641528:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20308a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.641542:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20308a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.641552:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20308a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.641564:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f203091 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.641578:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f203091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.641586:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f203091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.641906:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f203098 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.641915:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f203098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.641922:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f203098 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135971.641933:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787135971.642018:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20308a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642025:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20308a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642031:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20308a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642037:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e3800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135971.642040:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20308a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642080:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20308a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642103:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:3.0:1787135971.642106:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135971.642111:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20308a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642118:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20308a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642132:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f203091 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642137:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f203091 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642143:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f203091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642148:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e3a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135971.642151:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f203091 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642157:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f203091 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642164:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9843179e00) 00010000:00010000:3.0:1787135971.642166:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135971.642169:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f203091 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642175:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f203091 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642232:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f203083 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184d8 expref: 27 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642247:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f203098 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184d8 expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.642253:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:3.0:1787135971.642255:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787135971.642257:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e3400, rc 0) 00000100:00100000:3.0:1787135971.642321:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+26:11528:x1873947595458048:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 925us (2499us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787135971.642328:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 190 00000100:00100000:2.0:1787135971.648702:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135971.648872:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595458176 00000100:00100000:0.0:1787135971.648883:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595458176 00000100:00100000:0.0:1787135971.648941:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:0.0:1787135971.648952:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+26:11528:x1873947595458176:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:0.0:1787135971.649014:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2030a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.649031:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2030a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.649042:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2030a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.649112:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2030a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.649138:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2030a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.649144:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2030a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.649150:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135971.649155:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2030a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.649162:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2030a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.649174:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135971.649177:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787135971.649182:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2030a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.649188:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2030a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135971.649269:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+26:11528:x1873947595458176:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 318us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135971.649277:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 191 00000100:00100000:2.0:1787135971.651369:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135971.651430:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595458432 00000100:00100000:1.0:1787135971.651438:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595458432 00000100:00100000:1.0:1787135971.651488:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:1.0:1787135971.651498:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+26:11528:x1873947595458432:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1787135971.651708:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+27:11528:x1873947595458432:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 211us (345us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787135971.651716:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:1.0:1787135971.678705:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135971.679275:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595458688 00000100:00100000:0.0:1787135971.679286:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595458688 00000100:00100000:0.0:1787135971.679351:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:0.0:1787135971.679362:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+27:11054:x1873947595458688:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1787135971.679385:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135971.679420:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2030ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184df expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.679516:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.679531:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f203098 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184d8 expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.679540:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.679572:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f203098 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184d8 expref: 28 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.679658:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f203098 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184d8 expref: 28 pid: 5821 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135971.679673:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616421888:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135971.679771:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aef300 going to sleep for 11 seconds 00000100:00100000:0.0:1787135971.682305:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18d500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616421888:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787135971.682332:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135971.684136:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135971.684356:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595458816 00000100:00100000:0.0:1787135971.684365:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595458816 00010000:00010000:0.0:1787135971.684402:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f203098 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184d8 expref: 29 pid: 5821 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135971.684461:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:0.0:1787135971.684470:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+29:2361:x1873947595458816:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135971.684484:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135971.684490:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f203098 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184d8 expref: 29 pid: 5821 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.684504:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f203098 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184d8 expref: 29 pid: 5821 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.684538:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3400/0xf5850c552f203098 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184d8 expref: 29 pid: 5821 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.684555:0:7612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135971.684560:0:7612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.684568:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.684576:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.684711:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135971.684737:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135971.684747:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135971.684770:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+28:2361:x1873947595458816:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 301us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135971.684778:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 75 00000004:00200000:2.0:1787135971.684783:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1787135971.684939:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f2030ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184df expref: 29 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135971.684955:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184df expref: 28 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135971.684962:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:2.0:1787135971.684966:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787135971.684975:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897800, rc 0) 00000100:00100000:2.0:1787135971.685007:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+28:11054:x1873947595458688:12345-192.168.203.38@tcp:101:bash.0 Request processed in 5647us (6311us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1787135971.685014:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 192 00000100:00100000:1.0:1787135971.687591:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135971.687692:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595459072 00000100:00100000:3.0:1787135971.687703:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595459072 00000100:00100000:3.0:1787135971.687746:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 193 00000100:00100000:3.0:1787135971.687754:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+28:11054:x1873947595459072:12345-192.168.203.38@tcp:36:bash.0 00010000:00010000:3.0:1787135971.687996:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f2030c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.688012:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f2030c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.688023:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f2030c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787135971.688133:0:7623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787135971.688158:0:7623:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000007e4848d1 reply state 00000000880f10e3 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f2030c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135971.688177:0:7623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787135971.688232:0:7623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787135971.688327:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:11054:x1873947595459072:12345-192.168.203.38@tcp:36:bash.0 Request processed in 573us (743us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787135971.688334:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 193 00000020:00080000:3.0:1787135971.688339:0:7623:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787135971.696335:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f2030c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.696367:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f2030c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.696375:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f2030c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.696381:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135971.696386:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f2030c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.696393:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f2030c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.696409:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135971.696412:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135971.696473:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f2030c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.696482:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f2030c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135971.700778:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135971.702547:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595459200 00000100:00100000:3.0:1787135971.702570:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595459200 00000100:00100000:3.0:1787135971.702630:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:3.0:1787135971.702640:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+31:11054:x1873947595459200:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:3.0:1787135971.702665:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135971.702684:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f2030c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184e6 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.702739:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f2030c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184e6 expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.702753:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f2030c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184e6 expref: 32 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.702769:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:3.0:1787135971.702772:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135971.702775:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e3a00, rc 0) 00000100:00100000:3.0:1787135971.702834:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:11054:x1873947595459200:12345-192.168.203.38@tcp:101:bash.0 Request processed in 195us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135971.702841:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 194 00000100:00100000:3.0:1787135971.705179:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135971.705286:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595459328 00000100:00100000:0.0:1787135971.705295:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595459328 00000100:00100000:0.0:1787135971.705338:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:0.0:1787135971.705347:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:11054:x1873947595459328:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1787135971.705363:0:11994:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135971.705381:0:11994:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056a860de/0xf5850c552f2030d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184ed expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787135971.705405:0:11994:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8587e0, atime: 0x6a8587de, ctime: 0x6a8587e0, blocks: 0xb 00010000:00010000:0.0:1787135971.705442:0:11994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1787135971.705446:0:11994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135971.705453:0:11994:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056a860de/0xf5850c552f2030d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ed expref: 8 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.705468:0:11994:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000056a860de/0xf5850c552f2030d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ed expref: 8 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.705478:0:11994:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897000, rc 0) 00000100:00100000:0.0:1787135971.705530:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:11054:x1873947595459328:12345-192.168.203.38@tcp:101:bash.0 Request processed in 184us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135971.705536:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:1.0:1787135971.707643:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135971.707819:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595459456 00000100:00100000:0.0:1787135971.707829:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595459456 00002000:00010000:0.0:1787135971.707863:0:6680:0:(ofd_dev.c:2828:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787135971.707868:0:6680:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e987c1fc700 with x1873947595459456 ext(0->18446744073709551615) 00002000:00010000:0.0:1787135971.707879:0:6680:0:(ofd_dev.c:2833:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e987c1fc700. 00000100:00100000:0.0:1787135971.707909:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:0.0:1787135971.707928:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2359:x1873947595459456:12345-192.168.203.38@tcp:10:bash.0 00002000:00010000:0.0:1787135971.708205:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787135971.708209:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787135968 -> 1787135971 00002000:00010000:0.0:1787135971.708211:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787135966 -> 1787135966 00002000:00010000:0.0:1787135971.708223:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787135968 -> 1787135971 00002000:00010000:0.0:1787135971.708225:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787135971.708282:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2359:x1873947595459456:12345-192.168.203.38@tcp:10:bash.0 Request processed in 355us (645us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787135971.708303:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00002000:00010000:0.0:1787135971.708307:0:6680:0:(ofd_dev.c:2828:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787135971.708310:0:6680:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e987c1fc700 with x1873947595459456 ext(0->18446744073709551615) 00002000:00010000:0.0:1787135971.708315:0:6680:0:(ofd_dev.c:2833:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e987c1fc700. 00000100:00100000:2.0:1787135971.778971:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135971.779135:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595459584 00000100:00100000:0.0:1787135971.779145:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595459584 00000100:00100000:0.0:1787135971.779203:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 195 00000100:00100000:0.0:1787135971.779213:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:11542:x1873947595459584:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:0.0:1787135971.779291:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f2030d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.779308:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f2030d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.779319:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f2030d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.779334:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2030de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.779341:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2030de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.779347:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2030de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.779634:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f2030e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.779644:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f2030e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.779658:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f2030e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787135971.779695:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f2030e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.779707:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f2030d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.779715:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f2030d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780012:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f2030d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780018:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135971.780023:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f2030d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780030:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f2030d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780041:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:0.0:1787135971.780044:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135971.780091:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f2030d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780098:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f2030d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780110:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2030de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780122:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2030de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780127:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2030de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780132:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135971.780135:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2030de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780140:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2030de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780148:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e98494a1400) 00010000:00010000:0.0:1787135971.780150:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135971.780153:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2030de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780159:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f2030de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780173:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f2030e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780179:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f2030e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780185:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f2030e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780189:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135971.780198:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f2030e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780204:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f2030e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780211:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135971.780213:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135971.780225:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f2030e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.780232:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f2030e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135971.780310:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:11542:x1873947595459584:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 1096us (1345us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135971.780319:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 195 00000100:00100000:3.0:1787135971.813232:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135971.813394:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595459840 00000100:00100000:1.0:1787135971.813404:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595459840 00000100:00100000:1.0:1787135971.813465:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:1.0:1787135971.813475:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:11545:x1873947595459840:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787135971.813494:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135971.813512:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f2030ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184f4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.813588:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f2030f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.813601:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f2030f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.813611:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f2030f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.813638:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2030fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.813645:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2030fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.813652:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2030fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814154:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203101 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814164:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814314:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203101 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135971.814326:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787135971.814413:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f2030f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814422:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f2030f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814429:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f2030f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814434:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afa00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135971.814438:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f2030f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814457:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f2030f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814470:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:1.0:1787135971.814473:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135971.814478:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f2030f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814485:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f2030f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814497:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2030fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814503:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2030fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814509:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2030fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814514:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135971.814517:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2030fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814523:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2030fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814529:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9853809900) 00010000:00010000:1.0:1787135971.814532:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135971.814534:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2030fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814549:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f2030fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814866:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f2030ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184f4 expref: 35 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814880:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203101 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184f4 expref: 34 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.814887:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:1.0:1787135971.814890:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787135971.814892:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533afc00, rc 0) 00000100:00100000:1.0:1787135971.815398:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:11545:x1873947595459840:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1922us (2182us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1787135971.815407:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 196 00000100:00100000:1.0:1787135971.818453:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135971.818585:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595459968 00000100:00100000:3.0:1787135971.818595:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595459968 00000100:00100000:3.0:1787135971.818647:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 197 00000100:00100000:3.0:1787135971.818657:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:11545:x1873947595459968:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:3.0:1787135971.818714:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.818741:0:7623:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184df expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.818751:0:7623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.819493:0:7623:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184df expref: 34 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.819510:0:7623:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184df expref: 34 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135971.819523:0:7623:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616422016:192.168.203.38@tcp:104: 00000100:00100000:3.0:1787135971.819603:0:7623:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9849707cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135971.822545:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135971.822649:0:7623:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7623:1873947616422016:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787135971.822675:0:7623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135971.822793:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595460224 00000100:00100000:2.0:1787135971.822800:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595460224 00000100:00100000:2.0:1787135971.822852:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:2.0:1787135971.822862:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+35:5598:x1873947595460224:12345-192.168.203.38@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787135971.823371:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+36:5598:x1873947595460224:12345-192.168.203.38@tcp:35:ldlm_bl.0 Request processed in 508us (832us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787135971.823379:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:0.0:1787135971.830972:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135971.832653:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595460352 00000100:00100000:2.0:1787135971.832667:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595460352 00010000:00010000:2.0:1787135971.832710:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184df expref: 36 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135971.832907:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:2.0:1787135971.832927:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+36:2360:x1873947595460352:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135971.832941:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135971.832949:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184df expref: 36 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135971.832962:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184df expref: 36 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135971.832983:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f2030b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184df expref: 36 pid: 5822 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135971.833013:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:2.0:1787135971.833018:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135971.833027:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135971.833035:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135971.833518:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135971.833588:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457c8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+35:2360:x1873947595460352:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 661us (2623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135971.833596:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 76 00010000:00010000:1.0:1787135971.833682:0:7623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.833691:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.833726:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.833743:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.833748:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.833753:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e3800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135971.833757:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.833764:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.833783:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:1.0:1787135971.833786:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787135971.833790:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.833796:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20310f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135971.833836:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:11545:x1873947595459968:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 15181us (15392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135971.833845:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 197 00000100:00100000:1.0:1787135971.836871:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135971.837012:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595460608 00000100:00100000:2.0:1787135971.837022:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595460608 00000100:00100000:2.0:1787135971.837157:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1787135971.837167:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+34:11545:x1873947595460608:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1787135971.837493:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+35:11545:x1873947595460608:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 327us (630us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787135971.837501:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:2.0:1787135971.930556:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135971.930696:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595460864 00000100:00100000:0.0:1787135971.930705:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595460864 00000100:00100000:0.0:1787135971.930776:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:0.0:1787135971.930786:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+35:11556:x1873947595460864:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:0.0:1787135971.930809:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135971.930827:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f203116 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7184fb expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.930892:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20311d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.930906:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20311d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.931165:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20311d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.931355:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203124 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.931366:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.931383:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.931706:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f20312b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.931727:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f20312b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.931735:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f20312b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135971.931745:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787135971.932085:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20311d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932095:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20311d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932100:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20311d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932106:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135971.932111:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20311d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932118:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20311d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932130:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:1.0:1787135971.932133:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135971.932144:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20311d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932150:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897200/0xf5850c552f20311d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932161:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932166:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203124 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932182:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932188:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135971.932190:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932196:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203124 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932204:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9853809900) 00010000:00010000:1.0:1787135971.932207:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135971.932210:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203124 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932225:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203124 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932270:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f203116 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184fb expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932294:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f20312b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184fb expref: 37 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.932301:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:1.0:1787135971.932303:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787135971.932305:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533ae600, rc 0) 00000100:00100000:1.0:1787135971.932417:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+37:11556:x1873947595460864:12345-192.168.203.38@tcp:101:cat.0 Request processed in 1632us (1869us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787135971.932426:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 198 00000100:00100000:0.0:1787135971.939108:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135971.939252:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595461120 00000100:00100000:1.0:1787135971.939262:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595461120 00000100:00100000:1.0:1787135971.939318:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:1.0:1787135971.939327:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+37:11556:x1873947595461120:12345-192.168.203.38@tcp:35:cat.0 00000100:00100000:1.0:1787135971.939595:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+38:11556:x1873947595461120:12345-192.168.203.38@tcp:35:cat.0 Request processed in 268us (1217us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787135971.939604:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 54 00000100:00100000:2.0:1787135971.957302:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135971.957399:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595461376 00000100:00100000:0.0:1787135971.957409:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595461376 00000100:00100000:0.0:1787135971.957509:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 199 00000100:00100000:0.0:1787135971.957519:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+38:11557:x1873947595461376:12345-192.168.203.38@tcp:36:rm.0 00010000:00010000:0.0:1787135971.957567:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787135971.957591:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f20312b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184fb expref: 38 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.957612:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203101 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184f4 expref: 37 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.957624:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f2030c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184e6 expref: 36 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.957636:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e9843179600) 00010000:00010000:0.0:1787135971.957646:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787135971.957666:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f203139 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.957679:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f203139 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.957688:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f203139 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.957729:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203140 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.957737:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.957744:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.958275:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203147 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.958285:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203147 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.958292:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203147 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787135971.959351:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787135971.959361:0:5823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331902312907ns, next at 332902310887ns, rc = 0 00010000:00010000:0.0:1787135971.959420:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20314e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959431:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20314e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959439:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20314e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959447:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20314e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959464:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20314e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959470:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20314e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959486:0:5823:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787135971.959505:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203147 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959511:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203147 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959518:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203147 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959524:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135971.959528:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203147 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959535:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203147 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959545:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98494a1500) 00010000:00010000:0.0:1787135971.959548:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787135971.959551:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203147 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959557:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203147 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959572:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f203139 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959583:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f203139 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959589:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f203139 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959594:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135971.959597:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f203139 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959602:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f203139 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959609:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:0.0:1787135971.959612:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135971.959615:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f203139 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135971.959621:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897800/0xf5850c552f203139 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787135971.959630:0:5823:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000001cd20643 reply state 000000009de0bd09 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135971.959639:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787135971.960072:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787135971.960080:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20314e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.960087:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896e00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787135971.960096:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20314e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.960103:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20314e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.960112:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e98494a1500) 00010000:00010000:3.0:1787135971.960114:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787135971.960117:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20314e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.960124:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f20314e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135971.960138:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135971.960140:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135971.960142:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135971.962822:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203140 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.962839:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203140 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.962847:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203140 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.962852:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135971.962867:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203140 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.962875:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203140 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.962890:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e98494a1400) 00010000:00010000:1.0:1787135971.962893:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135971.962897:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203140 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135971.962905:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203140 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135971.964706:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+36:11557:x1873947595461376:12345-192.168.203.38@tcp:36:rm.0 Request processed in 2200us (2423us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787135971.964727:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 199 00000100:00100000:2.0:1787135972.011988:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135972.012308:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595461632 00000100:00100000:1.0:1787135972.012320:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595461632 00000100:00100000:1.0:1787135972.012384:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 200 00000100:00100000:1.0:1787135972.012394:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+36:11563:x1873947595461632:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1787135972.012416:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135972.012434:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203155 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718502 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.012549:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f20315c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.012563:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f20315c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.012574:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f20315c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.012604:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203163 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.012612:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203163 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.012618:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203163 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787135972.013532:0:5821:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1787135972.013685:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20316a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.013697:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20316a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.013706:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20316a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.013749:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f20315c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.013757:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f20315c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.013763:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f20315c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.013769:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afa00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135972.013773:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f20315c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.013792:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f20315c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.013803:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:1.0:1787135972.013806:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135972.013811:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f20315c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.013817:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f20315c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787135972.013829:0:5821:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000b67f0b74 reply state 0000000098e02841 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203163 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135972.013837:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787135972.013864:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203155 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718502 expref: 39 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.013878:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20316a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718502 expref: 38 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.013885:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9853809500) 00010000:00010000:1.0:1787135972.013887:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787135972.013889:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533aec00, rc 0) 00000100:00100000:1.0:1787135972.014188:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+39:11563:x1873947595461632:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1794us (2207us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1787135972.014196:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 200 00010000:00010000:0.0:1787135972.017666:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203163 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.017701:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203163 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.017710:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203163 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.017726:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afe00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135972.017731:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203163 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.017739:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203163 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.017755:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9853809900) 00010000:00010000:0.0:1787135972.017758:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787135972.017763:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203163 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.017777:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203163 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135972.019226:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135972.019463:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595461760 00000100:00100000:0.0:1787135972.019474:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595461760 00000100:00100000:0.0:1787135972.019521:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:0.0:1787135972.019530:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2361:x1873947595461760:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1787135972.019549:0:6672:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135972.019573:0:6672:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d7d4687/0xf5850c552f203178 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718509 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787135972.019616:0:6672:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787135972.019635:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=331s v=(0 0) 00010000:00010000:0.0:1787135972.019639:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135972.019647:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d7d4687/0xf5850c552f203178 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718509 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.019664:0:6672:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d7d4687/0xf5850c552f203178 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718509 expref: 6 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.019676:0:6672:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897800, rc 0) 00000100:00100000:0.0:1787135972.019742:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2361:x1873947595461760:12345-192.168.203.38@tcp:101:bash.0 Request processed in 213us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135972.019752:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:3.0:1787135972.022317:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135972.022388:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595461888 00000100:00100000:0.0:1787135972.022396:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595461888 00000100:00100000:0.0:1787135972.022449:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:0.0:1787135972.022459:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:11563:x1873947595461888:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:0.0:1787135972.022479:0:11994:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135972.022495:0:11994:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718510 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.022525:0:11994:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d7d4687/0xf5850c552f203178 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718509 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.022549:0:11994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135972.022553:0:11994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135972.022568:0:11994:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 7 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.022599:0:11994:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d7d4687/0xf5850c552f203178 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718509 expref: 7 pid: 6672 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.022612:0:11994:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d7d4687/0xf5850c552f203178 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718509 expref: 7 pid: 6672 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135972.022626:0:11994:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11994:1873947616422144:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135972.022700:0:11994:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aef900 going to sleep for 11 seconds 00000100:00100000:0.0:1787135972.027334:0:11994:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11994:1873947616422144:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787135972.027368:0:11994:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 7 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.027388:0:11994:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896600, rc 0) 00000100:00100000:0.0:1787135972.027440:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:11563:x1873947595461888:12345-192.168.203.38@tcp:101:bash.0 Request processed in 4983us (5277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135972.027450:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1787135972.029290:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.029354:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595462016 00000100:00100000:2.0:1787135972.029363:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595462016 00010000:00010000:2.0:1787135972.029400:0:5808:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d7d4687/0xf5850c552f203178 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718509 expref: 7 pid: 6672 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135972.029448:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:2.0:1787135972.029458:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2359:x1873947595462016:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135972.029473:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135972.029495:0:5808:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d7d4687/0xf5850c552f203178 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718509 expref: 7 pid: 6672 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.029509:0:5808:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d7d4687/0xf5850c552f203178 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718509 expref: 7 pid: 6672 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.029532:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d7d4687/0xf5850c552f203178 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718509 expref: 7 pid: 6672 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.029547:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135972.029551:0:5808:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135972.029559:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 6 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.029582:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 6 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.029619:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 6 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135972.029635:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974754fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873947616422272:192.168.203.38@tcp:105: 00000100:00100000:2.0:1787135972.030333:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9746146600 going to sleep for 11 seconds 00000100:00100000:2.0:1787135972.032853:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974754fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5808:1873947616422272:192.168.203.38@tcp:105: 00010000:00010000:2.0:1787135972.032875:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135972.033507:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595462016:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 4048us (4221us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.033519:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:1.0:1787135972.033795:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.035164:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595462272 00000100:00100000:2.0:1787135972.035311:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595462272 00000100:00100000:2.0:1787135972.035369:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:2.0:1787135972.035379:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+38:11563:x1873947595462272:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:2.0:1787135972.035785:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+39:11563:x1873947595462272:12345-192.168.203.38@tcp:35:bash.0 Request processed in 406us (1989us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787135972.035793:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 55 00000100:00100000:1.0:1787135972.154107:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135972.154247:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595462400 00000100:00100000:3.0:1787135972.154258:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595462400 00000100:00100000:3.0:1787135972.154315:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:3.0:1787135972.154326:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+39:11579:x1873947595462400:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135972.154349:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135972.154368:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f203186 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718517 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.154431:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f20318d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.154455:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f20318d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.154468:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f20318d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135972.154522:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1787135972.154525:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787135972.154545:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f20318d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.154580:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f203186 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718517 expref: 41 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.154600:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f20318d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718517 expref: 40 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.154609:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:3.0:1787135972.154611:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787135972.154614:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e3a00, rc 0) 00000100:00100000:3.0:1787135972.154671:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+40:11579:x1873947595462400:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 347us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135972.154678:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 201 00000100:00100000:0.0:1787135972.157856:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.157949:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595462656 00000100:00100000:2.0:1787135972.157959:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595462656 00000100:00100000:2.0:1787135972.158016:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:2.0:1787135972.158027:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+40:11579:x1873947595462656:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135972.158078:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135972.158098:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203194 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71851e expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.158191:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20319b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.158204:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20319b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.158242:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20319b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135972.158255:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787135972.158375:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203194 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71851e expref: 43 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.158392:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20319b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71851e expref: 42 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.158400:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9853809500) 00010000:00010000:2.0:1787135972.158403:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787135972.158406:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7a00, rc 0) 00000100:00100000:2.0:1787135972.158501:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+42:11579:x1873947595462656:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 476us (654us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1787135972.158509:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 202 00000100:00100000:2.0:1787135972.162079:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135972.162156:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595462912 00000100:00100000:3.0:1787135972.162166:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595462912 00000100:00100000:3.0:1787135972.162233:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 203 00000100:00100000:3.0:1787135972.162244:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+42:11579:x1873947595462912:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787135972.162267:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135972.162297:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f2031a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718525 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.162383:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2031b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.162398:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2031b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.162409:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2031b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135972.162420:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787135972.162532:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f2031a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718525 expref: 45 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.162550:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2031b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718525 expref: 44 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.162558:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9853809500) 00010000:00010000:3.0:1787135972.162573:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787135972.162577:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e2800, rc 0) 00000100:00100000:3.0:1787135972.162637:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+44:11579:x1873947595462912:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 396us (590us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787135972.162645:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 203 00000100:00100000:3.0:1787135972.167248:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135972.167327:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595463040 00000100:00100000:0.0:1787135972.167338:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595463040 00000100:00100000:0.0:1787135972.167416:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:0.0:1787135972.167427:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+44:2360:x1873947595463040:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135972.167444:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135972.167467:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20319b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71851e expref: 44 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.167484:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9853809500) 00010000:00010000:0.0:1787135972.167489:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135972.167545:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+43:2360:x1873947595463040:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 121us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135972.167553:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:1.0:1787135972.171363:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135972.171445:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595463168 00000100:00100000:0.0:1787135972.171455:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595463168 00000100:00100000:0.0:1787135972.171507:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:0.0:1787135972.171518:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+6:2359:x1873947595463168:12345-192.168.203.38@tcp:1:lfs.0 00010000:00010000:0.0:1787135972.171557:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.171586:0:6672:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 6 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.171595:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787135972.171598:0:6672:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787135972.171603:0:6672:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.171635:0:6672:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 6 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.171660:0:6672:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 6 pid: 11994 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135972.171675:0:6672:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1873947616422400:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135972.171975:0:6672:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aef900 going to sleep for 11 seconds 00000100:00100000:0.0:1787135972.174314:0:6672:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6672:1873947616422400:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787135972.174342:0:6672:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135972.176473:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135972.176529:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595463296 00000100:00100000:3.0:1787135972.176537:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595463296 00002000:00100000:3.0:1787135972.176586:0:6679:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e987c1fe300 x1873947595463296/t0(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:398/0 lens 504/0 e 0 to 0 dl 1787135983 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787135972.176608:0:6679:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e987c1fe300 with x1873947595463296 ext(0->8) 00010000:00010000:3.0:1787135972.176616:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 7 pid: 11994 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.176629:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 7 pid: 11994 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787135972.176635:0:6679:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e987c1fe300 00000100:00100000:3.0:1787135972.176658:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:3.0:1787135972.176664:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2359:x1873947595463296:12345-192.168.203.38@tcp:4:lfs.0 00000100:00100000:3.0:1787135972.177550:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2359:x1873947595463296:12345-192.168.203.38@tcp:4:lfs.0 Request processed in 881us (1132us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787135972.178666:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00002000:00100000:3.0:1787135972.178681:0:6679:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e987c1fe300 x1873947595463296/t4294967308(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:398/0 lens 504/448 e 0 to 0 dl 1787135983 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787135972.178691:0:6679:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e987c1fe300 with x1873947595463296 ext(0->8) 00010000:00010000:3.0:1787135972.178701:0:6679:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 9 pid: 11994 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.178718:0:6679:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 9 pid: 11994 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787135972.178726:0:6679:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8e987c1fe300 00000100:00100000:3.0:1787135972.180566:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135972.180783:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595463424 00000100:00100000:0.0:1787135972.180792:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595463424 00010000:00010000:0.0:1787135972.180830:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 9 pid: 11994 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135972.180871:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:0.0:1787135972.180881:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2362:x1873947595463424:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135972.180896:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787135972.180969:0:7612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787135972.180972:0:7612:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787135972 00002000:00010000:0.0:1787135972.180975:0:7612:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787135972 00002000:00010000:0.0:1787135972.180977:0:7612:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787135972 00010000:00010000:0.0:1787135972.180984:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 9 pid: 11994 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.181010:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 9 pid: 11994 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.181035:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003508e098/0xf5850c552f20317f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718510 expref: 9 pid: 11994 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.181129:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787135972.181134:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787135972.181140:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.181150:0:7612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.181227:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135972.181283:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2362:x1873947595463424:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 404us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135972.181291:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 78 00010000:00010000:1.0:1787135972.181897:0:6672:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.182107:0:6672:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.182138:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.182146:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.182155:0:6672:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.182162:0:6672:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787135972.182249:0:6672:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.182259:0:6672:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.182274:0:6672:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.182298:0:6672:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008fcc030b/0xf5850c552f2031be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135972.182418:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2359:x1873947595463168:12345-192.168.203.38@tcp:1:lfs.0 Request processed in 10893us (11054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135972.182426:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:3.0:1787135972.184734:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135972.185324:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595463680 00000100:00100000:1.0:1787135972.185333:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595463680 00000100:00100000:1.0:1787135972.185381:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 56 00000100:00100000:1.0:1787135972.185389:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842acfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+43:11579:x1873947595463680:12345-192.168.203.38@tcp:35:lfs.0 00000004:00010000:1.0:1787135972.185518:0:5825:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2031b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718525 expref: 43 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787135972.185765:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1787135972.185934:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1787135972.187506:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1787135972.187581:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.187601:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20316a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718502 expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.187611:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.187646:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20316a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718502 expref: 47 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.187676:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20316a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718502 expref: 47 pid: 5821 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135972.187690:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c1ff800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1873947616422528:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787135972.187958:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f5600 going to sleep for 11 seconds 00000100:00100000:3.0:1787135972.191166:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135972.191248:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c1ff800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5825:1873947616422528:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787135972.191274:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135972.191496:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595463808 00000100:00100000:0.0:1787135972.191504:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595463808 00010000:00010000:0.0:1787135972.191538:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20316a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718502 expref: 48 pid: 5821 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135972.191575:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:0.0:1787135972.191585:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+48:2359:x1873947595463808:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135972.191613:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135972.191620:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20316a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718502 expref: 48 pid: 5821 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.191632:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20316a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718502 expref: 48 pid: 5821 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.191652:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f20316a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718502 expref: 48 pid: 5821 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.191667:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9853809500) 00010000:00010000:0.0:1787135972.191671:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.191681:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.191688:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.191723:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135972.191772:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+47:2359:x1873947595463808:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 188us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135972.191780:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 79 00010000:00010000:1.0:1787135972.191884:0:5825:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.191892:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787135972.192024:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1787135972.192766:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1787135972.192868:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c1ff800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1873947616422656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787135972.192906:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135972.192927:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787135972.193090:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616422656 00000100:00100000:0.0:1787135972.193097:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616422656 00000100:00100000:0.0:1787135972.193146:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787135972.193156:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1873947616422656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787135972.193251:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5825:x1873947616422656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135972.193270:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787135972.193289:0:5825:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1787135972.193295:0:5825:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1787135972.193311:0:5825:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e987c18ed80, transno 4294967307 00000100:00100000:3.0:1787135972.193332:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c1ff800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1873947616422656:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1787135972.193479:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787135972.193923:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787135972.193981:0:5825:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e11f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1873947616422784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787135972.194016:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135972.194033:0:5825:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9849707600 going to sleep for 11 seconds 00000100:00100000:2.0:1787135972.194538:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616422784 00000100:00100000:2.0:1787135972.194544:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616422784 00000100:00100000:2.0:1787135972.194735:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787135972.194745:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5825:x1873947616422784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787135972.194926:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5825:x1873947616422784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 184us (909us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787135972.194934:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787135972.195004:0:5825:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e11f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5825:1873947616422784:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1787135972.195070:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1787135972.195107:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.195118:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.195125:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.195131:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533af200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135972.195136:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.195144:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.195158:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9853809500) 00010000:00010000:3.0:1787135972.195182:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787135972.195187:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.195194:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f2031c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5825 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787135972.195358:0:5825:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787135972.195927:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1787135972.195938:0:5825:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332138889490ns, next at 333138887610ns, rc = 0 00000001:00080000:3.0:1787135972.195945:0:5825:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1787135972.195979:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e9853809500) 00010000:00010000:3.0:1787135972.195982:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787135972.195989:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2031b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718525 expref: 51 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135972.196111:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842acfc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+50:11579:x1873947595463680:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 10722us (11383us total) trans 4294967494 rc 0/0 00000100:00100000:3.0:1787135972.196120:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 56 00000020:00080000:3.0:1787135972.196124:0:5825:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787135972.202363:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.202648:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595463936 00000100:00100000:2.0:1787135972.202659:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595463936 00000100:00100000:2.0:1787135972.202719:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:2.0:1787135972.202741:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+50:11579:x1873947595463936:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135972.202763:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135972.202793:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2031cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71852c expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.202849:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2031cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71852c expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.202863:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2031cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71852c expref: 51 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.202880:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135972.202883:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787135972.202886:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7800, rc 0) 00000100:00100000:2.0:1787135972.202943:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+51:11579:x1873947595463936:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 204us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.202950:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 204 00000100:00100000:1.0:1787135972.207853:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.208017:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595464192 00000100:00100000:2.0:1787135972.208029:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595464192 00000100:00100000:2.0:1787135972.208114:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:2.0:1787135972.208124:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+51:11579:x1873947595464192:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1787135972.208362:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:11579:x1873947595464192:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 238us (517us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787135972.208370:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 57 00000100:00100000:1.0:1787135972.315510:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787135972.315530:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c1fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616423168:0@lo:400:kworker.0 00000100:00100000:1.0:1787135972.315594:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135972.315681:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616423168 00000100:00100000:1.0:1787135972.315689:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616423168 00000100:00100000:1.0:1787135972.315740:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787135972.315750:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616423168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135972.315817:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616423168:12345-0@lo:400:kworker.0 Request processed in 70us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135972.315825:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1787135972.315846:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135972.315873:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c1fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616423168:0@lo:400:kworker.0 00000100:00100000:1.0:1787135972.315910:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c1fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616423296:0@lo:400:kworker.0 00000100:00100000:1.0:1787135972.315946:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135972.316203:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c1fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616423040:0@lo:400:kworker.0 00000100:00100000:3.0:1787135972.316243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135972.316271:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787135972.316277:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c1ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616422912:0@lo:400:kworker.0 00000100:00100000:3.0:1787135972.316303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135972.316321:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c1fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616423424:0@lo:400:kworker.0 00000100:00100000:3.0:1787135972.316346:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135972.316513:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616423296 00000100:00100000:2.0:1787135972.316519:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616423296 00000100:00100000:2.0:1787135972.316558:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616423040 00000100:00100000:2.0:1787135972.316568:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616423040 00000100:00100000:2.0:1787135972.316586:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787135972.316593:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616423296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135972.316635:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616423296:12345-0@lo:400:kworker.0 Request processed in 43us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.316643:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787135972.316656:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787135972.316662:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616423040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787135972.316689:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616423040:12345-0@lo:400:kworker.0 Request processed in 28us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.316696:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787135972.316892:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616422912 00000100:00100000:0.0:1787135972.316896:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616422912 00000100:00100000:0.0:1787135972.316937:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1787135972.316943:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616422912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135972.316973:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3301:x1873947616422912:12345-0@lo:400:kworker.0 Request processed in 30us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135972.316978:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:3.0:1787135972.317118:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135972.317145:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c1ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e67bffa2-3749-4eab-9303-62ad12948de4:3301:1873947616422912:0@lo:400:kworker.0 00000100:00100000:3.0:1787135972.317174:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c1fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616423040:0@lo:400:kworker.0 00000100:00100000:1.0:1787135972.317336:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616423424 00000100:00100000:1.0:1787135972.317342:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616423424 00000100:00100000:1.0:1787135972.317384:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787135972.317391:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616423424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135972.317447:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616423424:12345-0@lo:400:kworker.0 Request processed in 57us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135972.317454:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787135972.317482:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c1fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616423296:0@lo:400:kworker.0 00000100:00100000:2.0:1787135972.317610:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c1fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616423424:0@lo:400:kworker.0 00000100:00080000:3.0:1787135972.317900:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787135972.318279:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.318415:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595464320 00000100:00100000:2.0:1787135972.318420:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595464320 00000100:00100000:2.0:1787135972.318455:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 205 00000100:00100000:2.0:1787135972.318463:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:11589:x1873947595464320:12345-192.168.203.38@tcp:34:lfs.0 00010000:00010000:2.0:1787135972.318525:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031d3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318542:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318553:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318569:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318590:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318597:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318691:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318700:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318707:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787135972.318743:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318755:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031d3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318761:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031d3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318784:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318790:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135972.318794:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318802:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031d3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318821:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:2.0:1787135972.318824:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135972.318829:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318836:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318848:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318854:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318859:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318865:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135972.318868:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318874:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318881:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e98532d1700) 00010000:00010000:2.0:1787135972.318883:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135972.318886:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031da lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318891:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318927:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318933:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318938:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318943:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135972.318946:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318951:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318958:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135972.318960:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135972.318962:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.318968:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135972.319029:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:11589:x1873947595464320:12345-192.168.203.38@tcp:34:lfs.0 Request processed in 566us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.319037:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 205 00000100:00100000:1.0:1787135972.369482:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.369605:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595464576 00000100:00100000:2.0:1787135972.369616:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595464576 00000100:00100000:2.0:1787135972.369705:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 206 00000100:00100000:2.0:1787135972.369736:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+52:11592:x1873947595464576:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135972.369756:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135972.369795:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718533 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.369867:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.369882:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.369893:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.369916:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.369923:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.369930:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370084:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2031fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370093:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2031fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370099:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2031fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135972.370120:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787135972.370391:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370400:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370406:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370411:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135972.370415:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370423:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370434:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:2.0:1787135972.370437:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135972.370442:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370447:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f2031ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370459:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370465:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370480:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370484:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135972.370487:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370493:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370500:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e98532d1700) 00010000:00010000:2.0:1787135972.370502:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135972.370505:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370511:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f2031f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370551:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2031e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718533 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370566:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2031fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718533 expref: 54 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.370573:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135972.370576:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787135972.370579:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6c00, rc 0) 00000100:00100000:2.0:1787135972.370689:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:11592:x1873947595464576:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 956us (1214us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1787135972.370705:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 206 00000100:00100000:3.0:1787135972.374505:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.374563:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595464704 00000100:00100000:2.0:1787135972.374573:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595464704 00000100:00100000:2.0:1787135972.374631:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 207 00000100:00100000:2.0:1787135972.374641:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:11592:x1873947595464704:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:2.0:1787135972.374731:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f20320b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.374747:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f20320b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.374759:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f20320b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.374783:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f20320b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.374790:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f20320b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.374796:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f20320b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.374802:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135972.374806:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f20320b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.374813:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f20320b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.374823:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135972.374831:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787135972.374835:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f20320b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.374841:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6800/0xf5850c552f20320b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135972.375137:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:11592:x1873947595464704:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 497us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.375145:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 207 00000100:00100000:3.0:1787135972.377575:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.377652:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595464960 00000100:00100000:2.0:1787135972.377661:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595464960 00000100:00100000:2.0:1787135972.377722:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 58 00000100:00100000:2.0:1787135972.377733:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+54:11592:x1873947595464960:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:2.0:1787135972.377935:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:11592:x1873947595464960:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 204us (380us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1787135972.377943:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 58 00010000:00010000:3.0:1787135972.440189:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135972.442871:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135972.442937:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595465216 00000100:00100000:1.0:1787135972.442946:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595465216 00000100:00100000:1.0:1787135972.443003:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 208 00000100:00100000:1.0:1787135972.443013:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:11602:x1873947595465216:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1787135972.443036:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135972.443039:0:5821:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787135972.443097:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3a00/0xf5850c552f20318d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718517 expref: 55 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.443116:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:1.0:1787135972.443122:0:5821:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787135972.443135:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203212 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71853a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.443238:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.443253:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2031fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718533 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.443261:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.443291:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2031fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718533 expref: 55 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.443304:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2031fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718533 expref: 55 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135972.443317:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c1fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616423552:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787135972.443454:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787135972.446756:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135972.446919:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c1fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616423552:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787135972.446944:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135972.447365:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595465344 00000100:00100000:0.0:1787135972.447372:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595465344 00010000:00010000:0.0:1787135972.447405:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2031fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718533 expref: 56 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135972.447435:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:0.0:1787135972.447444:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+56:2359:x1873947595465344:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135972.447458:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135972.447464:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2031fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718533 expref: 56 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.447478:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2031fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718533 expref: 56 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.447500:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2031fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718533 expref: 56 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.447514:0:7612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:0.0:1787135972.447526:0:7612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.447535:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.447542:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.447697:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135972.447972:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c122a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:2359:x1873947595465344:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 525us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135972.447981:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00010000:00010000:1.0:1787135972.449080:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.449091:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135972.449109:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787135972.449261:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f203212 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71853a expref: 56 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.449280:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71853a expref: 55 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.449288:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:1.0:1787135972.449291:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787135972.449293:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533ae000, rc 0) 00000100:00100000:1.0:1787135972.449336:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:11602:x1873947595465216:12345-192.168.203.38@tcp:101:bash.0 Request processed in 6325us (6473us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787135972.449343:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 208 00000100:00100000:3.0:1787135972.452614:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135972.453038:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595465600 00000100:00100000:0.0:1787135972.453161:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595465600 00000100:00100000:0.0:1787135972.453257:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 209 00000100:00100000:0.0:1787135972.453267:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+55:11602:x1873947595465600:12345-192.168.203.38@tcp:36:bash.0 00010000:00010000:0.0:1787135972.453530:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203227 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.453547:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.453568:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787135972.453618:0:7623:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787135972.453642:0:7623:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000002e992c8b reply state 0000000035068ebd transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135972.453651:0:7623:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787135972.453814:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11602:x1873947595465600:12345-192.168.203.38@tcp:36:bash.0 Request processed in 548us (1207us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787135972.453821:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 209 00000020:00080000:0.0:1787135972.453826:0:7623:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787135972.455950:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203227 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.455967:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203227 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.455975:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203227 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.455981:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135972.455997:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203227 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.456006:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203227 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.456021:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:1.0:1787135972.456025:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135972.456029:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203227 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.456036:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203227 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135972.456615:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.456744:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595465728 00000100:00100000:2.0:1787135972.456753:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595465728 00000100:00100000:2.0:1787135972.456807:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 210 00000100:00100000:2.0:1787135972.456818:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:11602:x1873947595465728:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1787135972.456839:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135972.456856:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20322e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718541 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.456937:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.456951:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71853a expref: 58 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.456968:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.457001:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71853a expref: 58 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.457015:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71853a expref: 58 pid: 5821 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135972.457030:0:5823:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974754c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1873947616423680:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135972.457139:0:5823:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9746146d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787135972.459429:0:5823:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974754c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5823:1873947616423680:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135972.459457:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135972.460968:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.462164:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595465856 00000100:00100000:2.0:1787135972.462175:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595465856 00010000:00010000:2.0:1787135972.462226:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71853a expref: 59 pid: 5821 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135972.462396:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:2.0:1787135972.462407:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:2359:x1873947595465856:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135972.462421:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135972.462428:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71853a expref: 59 pid: 5821 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.462459:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71853a expref: 59 pid: 5821 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.462481:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203219 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71853a expref: 59 pid: 5821 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.462496:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135972.462501:0:5807:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.462510:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.462518:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.462549:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787135972.462637:0:5823:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.462645:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135972.462690:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787135972.462694:0:5823:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787135972.462714:0:5823:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.462758:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20322e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718541 expref: 59 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.462784:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718541 expref: 58 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.462791:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:1.0:1787135972.462803:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787135972.462807:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6e00, rc 0) 00000100:00100000:1.0:1787135972.462873:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11602:x1873947595465728:12345-192.168.203.38@tcp:101:bash.0 Request processed in 6056us (6261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135972.462881:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 210 00000100:00100000:3.0:1787135972.465704:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.465705:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:2359:x1873947595465856:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 3233us (4675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.465718:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:1.0:1787135972.466543:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595466112 00000100:00100000:1.0:1787135972.466553:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595466112 00000100:00100000:1.0:1787135972.466606:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:1.0:1787135972.466616:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+57:11602:x1873947595466112:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:1.0:1787135972.466834:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11602:x1873947595466112:12345-192.168.203.38@tcp:35:bash.0 Request processed in 219us (1131us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787135972.466842:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 59 00000100:00100000:3.0:1787135972.522301:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.522453:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595466240 00000100:00100000:2.0:1787135972.522463:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595466240 00000100:00100000:2.0:1787135972.522523:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 211 00000100:00100000:2.0:1787135972.522533:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+58:11608:x1873947595466240:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135972.522564:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135972.522585:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20323c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718548 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.522665:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f203243 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.522678:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f203243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.522689:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f203243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135972.522753:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787135972.522757:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135972.522789:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f203243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.522814:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20323c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718548 expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.522832:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f203243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718548 expref: 59 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.522840:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:2.0:1787135972.522843:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787135972.522846:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7400, rc 0) 00000100:00100000:2.0:1787135972.524893:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11608:x1873947595466240:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 374us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.525023:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 211 00000100:00100000:0.0:1787135972.527184:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135972.527356:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595466368 00000100:00100000:1.0:1787135972.527366:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595466368 00000100:00100000:1.0:1787135972.527450:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:1.0:1787135972.527462:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11608:x1873947595466368:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787135972.527482:0:7623:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135972.527498:0:7623:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20324a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71854f expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527565:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f203251 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527580:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f203251 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527592:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f203251 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527623:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203258 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527630:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527637:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527739:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f20325f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527747:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f20325f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527753:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f20325f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135972.527795:0:7623:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787135972.527799:0:7623:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787135972.527815:0:7623:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f20325f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527826:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f20325f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527835:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f203251 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527841:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f203251 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527857:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f203251 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527862:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533af800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135972.527865:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f203251 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527872:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f203251 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527884:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:1.0:1787135972.527887:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135972.527891:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f203251 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.527896:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f203251 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.528315:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203258 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.528324:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203258 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.528330:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.528334:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afc00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135972.528337:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203258 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.528352:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203258 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.528361:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9853809700) 00010000:00010000:1.0:1787135972.528363:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135972.528366:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203258 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.528371:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203258 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.528404:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20324a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71854f expref: 61 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.528419:0:7623:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f20325f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71854f expref: 60 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.528426:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:1.0:1787135972.528428:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787135972.528430:0:7623:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533ae600, rc 0) 00000100:00100000:1.0:1787135972.528494:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:11608:x1873947595466368:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1034us (1317us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135972.528501:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 212 00000100:00100000:0.0:1787135972.532703:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.533274:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595466496 00000100:00100000:2.0:1787135972.533284:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595466496 00000100:00100000:2.0:1787135972.533394:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:2.0:1787135972.533406:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:2362:x1873947595466496:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135972.533419:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135972.533444:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f20325f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71854f expref: 60 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.533460:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135972.533465:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135972.533521:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:2362:x1873947595466496:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 118us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.533529:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:3.0:1787135972.535352:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135972.535679:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595466752 00000100:00100000:1.0:1787135972.535688:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595466752 00000100:00100000:1.0:1787135972.535737:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 213 00000100:00100000:1.0:1787135972.535746:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11608:x1873947595466752:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787135972.535843:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135972.535863:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203266 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718556 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.535952:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.535967:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718541 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.535976:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.536005:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718541 expref: 60 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.536018:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718541 expref: 60 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135972.536031:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c1fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616423808:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787135972.536132:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787135972.539659:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135972.539940:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c1fdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616423808:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787135972.539966:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135972.540204:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595466880 00000100:00100000:0.0:1787135972.540240:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595466880 00010000:00010000:0.0:1787135972.540276:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718541 expref: 61 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135972.540313:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:0.0:1787135972.540322:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c120a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:2359:x1873947595466880:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135972.540336:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135972.540343:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718541 expref: 61 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.540354:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718541 expref: 61 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.540375:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203235 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718541 expref: 61 pid: 5823 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.540390:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:0.0:1787135972.540395:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.540404:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.540426:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.540453:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135972.540505:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c120a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:2359:x1873947595466880:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 184us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135972.540513:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 82 00010000:00010000:1.0:1787135972.541278:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.541288:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135972.541312:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787135972.541472:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f203266 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718556 expref: 61 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.541489:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718556 expref: 60 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.541497:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:1.0:1787135972.541500:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787135972.541502:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533aee00, rc 0) 00000100:00100000:1.0:1787135972.541544:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c123480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:11608:x1873947595466752:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 5799us (6199us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787135972.541551:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 213 00000100:00100000:3.0:1787135972.563843:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135972.564188:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595467136 00000100:00100000:0.0:1787135972.564198:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595467136 00000100:00100000:0.0:1787135972.564278:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1787135972.564288:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:11608:x1873947595467136:12345-192.168.203.38@tcp:103:lfs.0 00010000:00010000:0.0:1787135972.564305:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135972.564327:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f2031cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71852c expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135972.564346:0:7612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:0.0:1787135972.564352:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135972.564400:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c121880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11608:x1873947595467136:12345-192.168.203.38@tcp:103:lfs.0 Request processed in 113us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135972.564408:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1787135972.578380:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.578780:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595467264 00000100:00100000:2.0:1787135972.578791:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595467264 00000100:00100000:2.0:1787135972.578850:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 214 00000100:00100000:2.0:1787135972.578859:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11608:x1873947595467264:12345-192.168.203.38@tcp:58:lfs.0 00010000:00010000:2.0:1787135972.579133:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20327b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.579149:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20327b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.579161:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20327b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787135972.579340:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1787135972.580403:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11608:x1873947595467264:12345-192.168.203.38@tcp:58:lfs.0 Request processed in 1541us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135972.580413:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 214 00000100:00100000:3.0:1787135972.582155:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.583105:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595467392 00000100:00100000:2.0:1787135972.583114:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595467392 00000100:00100000:2.0:1787135972.583169:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 215 00000100:00100000:2.0:1787135972.583180:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+59:11608:x1873947595467392:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135972.583226:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135972.583246:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203282 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71855d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.583297:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20327b lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.583307:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203282 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71855d expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.583325:0:5822:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20327b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.583338:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203282 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71855d expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.583361:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135972.583364:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787135972.583368:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203282 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71855d expref: 60 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.583375:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7800, rc 0) 00000100:00100000:2.0:1787135972.583435:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c120380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:11608:x1873947595467392:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 257us (1286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.583443:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 215 00000100:00100000:2.0:1787135972.826366:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974754c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616423936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787135972.826434:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135972.826538:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616423936 00000100:00100000:2.0:1787135972.826545:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616423936 00000100:00100000:2.0:1787135972.826596:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787135972.826604:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616423936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787135972.826634:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135972.826683:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3301:x1873947616423936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.826692:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787135972.826825:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787135972.826838:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616424064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787135972.826864:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974754c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616423936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787135972.826872:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135972.826931:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616424064 00000100:00100000:1.0:1787135972.826935:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616424064 00000100:00100000:1.0:1787135972.826967:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787135972.826974:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1873947616424064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787135972.826985:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135972.827027:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c122680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1873947616424064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135972.827033:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787135972.827409:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c122d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616424064:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1787135972.889729:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787135972.889738:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787135972.889803:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1787135972.889809:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787135972.892522:0:11666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974754c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1873947616424192:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787135972.892693:0:11666:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98435086c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787135972.898972:0:11666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974754c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1873947616424192:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787135972.910829:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135972.911511:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595467520 00000100:00100000:1.0:1787135972.911524:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595467520 00000100:00100000:1.0:1787135972.911592:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 216 00000100:00100000:1.0:1787135972.911602:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:11609:x1873947595467520:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787135972.911633:0:7623:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787135972.911965:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:11609:x1873947595467520:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 362us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135972.911973:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 216 00000100:00100000:1.0:1787135972.919264:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.920190:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595467648 00000100:00100000:2.0:1787135972.920202:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595467648 00000100:00100000:2.0:1787135972.920275:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 217 00000100:00100000:2.0:1787135972.920286:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:11609:x1873947595467648:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787135972.920363:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203289 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920380:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203289 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920390:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203289 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920417:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f203290 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920425:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f203290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920432:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f203290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920452:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f203297 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920459:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f203297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920464:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f203297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135972.920500:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787135972.920504:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787135972.920526:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f203297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920538:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203289 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920545:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203289 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920553:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203289 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920569:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135972.920573:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203289 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920581:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203289 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920594:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9853809600) 00010000:00010000:2.0:1787135972.920597:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135972.920601:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203289 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920607:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203289 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920619:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f203290 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920626:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f203290 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920632:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f203290 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920637:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135972.920640:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f203290 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920645:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f203290 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920661:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8e98532d1700) 00010000:00010000:2.0:1787135972.920663:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135972.920666:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f203290 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920673:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f203290 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920687:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f203297 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920692:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f203297 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920696:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f203297 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920701:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135972.920704:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f203297 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920710:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f203297 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920717:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135972.920719:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135972.920721:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f203297 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.920744:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f203297 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135972.920822:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:11609:x1873947595467648:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 Request processed in 537us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.920831:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 217 00000100:00100000:0.0:1787135972.933422:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135972.933523:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595467904 00000100:00100000:3.0:1787135972.933532:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595467904 00000100:00100000:3.0:1787135972.933611:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 218 00000100:00100000:3.0:1787135972.933621:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+60:11609:x1873947595467904:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787135972.933640:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135972.933662:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20329e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718564 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.933745:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.933760:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.933771:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787135972.933783:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787135972.933874:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.933882:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.933888:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.933894:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135972.933899:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.933914:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.933936:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135972.933939:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787135972.933943:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.933950:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.933994:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20329e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718564 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.934005:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9853809600) 00010000:00010000:3.0:1787135972.934007:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787135972.934010:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20329e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718564 expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.934021:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e3800, rc 0) 00000100:00100000:3.0:1787135972.934135:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:11609:x1873947595467904:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 515us (723us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787135972.934143:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 218 00000100:00100000:0.0:1787135972.938858:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.938949:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595468032 00000100:00100000:2.0:1787135972.938959:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595468032 00000100:00100000:2.0:1787135972.939012:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 219 00000100:00100000:2.0:1787135972.939022:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:11609:x1873947595468032:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787135972.939083:0:5822:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787135972.939184:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:11609:x1873947595468032:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 162us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135972.939192:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 219 00000100:00100000:0.0:1787135972.943179:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135972.943492:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595468288 00000100:00100000:3.0:1787135972.943502:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595468288 00000100:00100000:3.0:1787135972.943567:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:3.0:1787135972.943577:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:11609:x1873947595468288:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787135972.943596:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135972.943599:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787135972.943624:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7400/0xf5850c552f203243 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718548 expref: 61 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.943667:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:3.0:1787135972.943672:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787135972.943686:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f2032b3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71856b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787135972.944597:0:5823:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:3.0:1787135972.946231:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.946250:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.946262:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.946322:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f2032b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71856b expref: 63 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.946342:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71856b expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135972.946351:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9843179e00) 00010000:00010000:3.0:1787135972.946353:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787135972.946357:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e2800, rc 0) 00000100:00100000:3.0:1787135972.946481:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+62:11609:x1873947595468288:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 2906us (3309us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1787135972.946490:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 220 00000100:00100000:0.0:1787135972.969155:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135972.972847:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595468544 00000100:00100000:2.0:1787135972.972861:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595468544 00000100:00100000:2.0:1787135972.973348:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 221 00000100:00100000:2.0:1787135972.973360:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+62:11609:x1873947595468544:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787135972.973415:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135972.973440:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2800/0xf5850c552f2032ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71856b expref: 62 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973471:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9843179e00) 00010000:00010000:2.0:1787135972.973483:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135972.973504:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2032c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973517:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2032c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973545:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2032c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973573:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x18c60cd1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973581:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x18c60cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973588:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x18c60cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973672:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2032c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973680:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2032c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973685:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2032c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973691:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135972.973695:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2032c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973703:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2032c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973711:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:2.0:1787135972.973714:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135972.973717:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2032c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973729:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6c00/0xf5850c552f2032c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973740:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x18c60cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973746:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x18c60cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973751:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x18c60cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973757:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135972.973760:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x18c60cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973766:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x18c60cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973784:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x18c60cd1 (ffff8e98532d1700) 00010000:00010000:2.0:1787135972.973786:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135972.973789:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x18c60cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135972.973794:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x18c60cd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135972.973879:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:11609:x1873947595468544:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 521us (4734us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787135972.973897:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 221 00000100:00100000:0.0:1787135972.977168:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135972.977662:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595468672 00000100:00100000:1.0:1787135972.977673:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595468672 00000100:00100000:1.0:1787135972.977734:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 222 00000100:00100000:1.0:1787135972.977744:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+61:11609:x1873947595468672:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787135972.977763:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135972.977784:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2032d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718572 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.977815:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f2032dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.977828:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f2032dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.977839:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f2032dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.977953:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2032d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718572 expref: 63 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.978219:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f2032dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718572 expref: 62 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.978229:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9853809700) 00010000:00010000:1.0:1787135972.978231:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787135972.978241:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533afe00, rc 0) 00000100:00100000:1.0:1787135972.978292:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+62:11609:x1873947595468672:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 550us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135972.978299:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 222 00000100:00100000:1.0:1787135972.992920:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135972.993716:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595468928 00000100:00100000:3.0:1787135972.993726:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595468928 00000100:00100000:1.0:1787135972.994282:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 223 00000100:00100000:1.0:1787135972.994296:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+62:11609:x1873947595468928:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787135972.994375:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2032e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.994393:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2032e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135972.994404:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2032e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787135972.995219:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1787135972.995231:0:5821:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332938182467ns, next at 333938179357ns, rc = 0 00000004:00010000:1.0:1787135972.995317:0:5821:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000009ba6237e reply state 000000002555409b transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2032e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135972.995327:0:5821:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787135972.995679:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+64:11609:x1873947595468928:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 1383us (2764us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787135972.995688:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 223 00000100:00100000:1.0:1787135973.000779:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135973.000917:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595469056 00000100:00100000:2.0:1787135973.000928:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595469056 00000100:00100000:2.0:1787135973.001004:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 224 00000100:00100000:2.0:1787135973.001016:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+64:11609:x1873947595469056:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787135973.001036:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135973.001079:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718579 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.001133:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718579 expref: 65 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.001147:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718579 expref: 65 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.001161:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9853809700) 00010000:00010000:2.0:1787135973.001164:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787135973.001168:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7a00, rc 0) 00000100:00100000:2.0:1787135973.001225:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+65:11609:x1873947595469056:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 212us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135973.001232:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 224 00000100:00080000:3.0:1787135973.001488:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135973.004199:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135973.004679:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595469184 00000100:00100000:3.0:1787135973.004689:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595469184 00000100:00100000:3.0:1787135973.004768:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:3.0:1787135973.004779:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2359:x1873947595469184:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787135973.005128:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787135973.005288:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:2359:x1873947595469184:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 510us (1095us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1787135973.005296:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00010000:00010000:0.0:1787135973.006829:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2032e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.006843:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2032e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.006851:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2032e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.006856:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533af800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787135973.006861:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2032e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.006869:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2032e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.006885:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9853809700) 00010000:00010000:0.0:1787135973.006895:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787135973.006904:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2032e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.006911:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2032e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135973.009776:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135973.009860:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595469440 00000100:00100000:3.0:1787135973.009870:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595469440 00000100:00100000:3.0:1787135973.010179:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:3.0:1787135973.010190:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+64:11609:x1873947595469440:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787135973.010425:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+65:11609:x1873947595469440:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 236us (658us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1787135973.010432:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 60 00000100:00100000:1.0:1787135973.017325:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135973.017407:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595469696 00000100:00100000:3.0:1787135973.017416:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595469696 00000100:00100000:3.0:1787135973.017482:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 225 00000100:00100000:3.0:1787135973.017493:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+65:11609:x1873947595469696:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787135973.017619:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+65:11609:x1873947595469696:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 127us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135973.017627:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 225 00000100:00100000:3.0:1787135973.020119:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135973.020279:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595469824 00000100:00100000:0.0:1787135973.020287:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595469824 00000100:00100000:0.0:1787135973.020332:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 226 00000100:00100000:0.0:1787135973.020342:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+65:11609:x1873947595469824:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787135973.020361:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135973.020381:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f2032f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718580 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.020486:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f2032f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.020501:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f2032f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.020511:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f2032f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787135973.020543:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787135973.020572:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f2032f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.020596:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897e00/0xf5850c552f2032f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718580 expref: 67 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.020612:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f2032f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718580 expref: 66 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.020620:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9853809700) 00010000:00010000:0.0:1787135973.020623:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787135973.020626:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896e00, rc 0) 00000100:00100000:0.0:1787135973.020673:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+66:11609:x1873947595469824:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 333us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135973.020680:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 226 00000100:00100000:0.0:1787135973.025517:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135973.025753:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595469952 00000100:00100000:1.0:1787135973.025763:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595469952 00000100:00100000:1.0:1787135973.025819:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:1.0:1787135973.025830:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+10:2360:x1873947595469952:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787135973.025849:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135973.025869:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a7ddb44/0xf5850c552f203300 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718587 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787135973.025912:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8587e4, blocks: 0x1 00010000:00010000:1.0:1787135973.025931:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1787135973.025936:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787135973.025946:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a7ddb44/0xf5850c552f203300 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718587 expref: 11 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.025964:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a7ddb44/0xf5850c552f203300 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718587 expref: 11 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.026167:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533aec00, rc 0) 00000100:00100000:1.0:1787135973.026230:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+11:2360:x1873947595469952:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 401us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135973.026237:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:1.0:1787135973.036935:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135973.037022:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595470208 00000100:00100000:3.0:1787135973.037068:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595470208 00000100:00100000:3.0:1787135973.037124:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 227 00000100:00100000:3.0:1787135973.037134:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+66:11609:x1873947595470208:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787135973.037245:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+66:11609:x1873947595470208:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 113us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135973.037253:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 227 00000100:00100000:3.0:1787135973.041783:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135973.041950:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595470336 00000100:00100000:2.0:1787135973.041960:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595470336 00000100:00100000:2.0:1787135973.042017:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:2.0:1787135973.042027:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+11:11609:x1873947595470336:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787135973.042074:0:6673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135973.042094:0:6673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71858e expref: -99 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.042142:0:6673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a7ddb44/0xf5850c552f203300 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718587 expref: 12 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.042152:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135973.042156:0:6673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135973.042162:0:6673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71858e expref: 12 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.042197:0:6673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a7ddb44/0xf5850c552f203300 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718587 expref: 12 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.042220:0:6673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a7ddb44/0xf5850c552f203300 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718587 expref: 12 pid: 6674 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135973.042235:0:6673:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974754c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1873947616424320:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135973.042330:0:6673:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98435086c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135973.045379:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135973.045477:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595470464 00000100:00100000:0.0:1787135973.045485:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595470464 00010000:00010000:0.0:1787135973.045543:0:5807:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a7ddb44/0xf5850c552f203300 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718587 expref: 13 pid: 6674 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135973.045582:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:0.0:1787135973.045593:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2360:x1873947595470464:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135973.045606:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135973.045629:0:5807:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a7ddb44/0xf5850c552f203300 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718587 expref: 13 pid: 6674 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.045643:0:5807:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a7ddb44/0xf5850c552f203300 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718587 expref: 13 pid: 6674 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.045666:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135973.045671:0:5807:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787135973.045679:0:5807:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71858e expref: 13 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.045690:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71858e expref: 13 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.045725:0:5807:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71858e expref: 13 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135973.045749:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873947616424448:192.168.203.38@tcp:105: 00000100:00100000:0.0:1787135973.045823:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aefd80 going to sleep for 11 seconds 00010000:00010000:2.0:1787135973.047280:0:6673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a7ddb44/0xf5850c552f203300 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718587 expref: 13 pid: 6674 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135973.047301:0:6673:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974754c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6673:1873947616424320:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135973.047329:0:6673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71858e expref: 12 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.047351:0:6673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6e00, rc 0) 00000100:00100000:2.0:1787135973.047418:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+12:11609:x1873947595470336:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 5391us (5643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135973.047426:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:0.0:1787135973.049694:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5807:1873947616424448:192.168.203.38@tcp:105: 00010000:00010000:0.0:1787135973.049785:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135973.049880:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+11:2360:x1873947595470464:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 4288us (4506us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135973.049891:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:1.0:1787135973.055559:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135973.055694:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595470592 00000100:00100000:2.0:1787135973.055705:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595470592 00002000:00100000:2.0:1787135973.055760:0:6678:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8e9881fa5c00 x1873947595470592/t0(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:399/0 lens 504/0 e 0 to 0 dl 1787135984 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787135973.055772:0:6678:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e9881fa5c00 with x1873947595470592 ext(0->12) 00002000:00010000:2.0:1787135973.055778:0:6678:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e9881fa5c00 00000100:00100000:2.0:1787135973.055812:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1787135973.055821:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+11:2360:x1873947595470592:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787135973.056306:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2360:x1873947595470592:12345-192.168.203.38@tcp:4:lhsmtool_posix.0 Request processed in 484us (754us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1787135973.056315:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00002000:00100000:2.0:1787135973.056323:0:6678:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8e9881fa5c00 x1873947595470592/t4294967320(0) o4->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:399/0 lens 504/448 e 0 to 0 dl 1787135984 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787135973.056332:0:6678:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e9881fa5c00 with x1873947595470592 ext(0->12) 00002000:00010000:2.0:1787135973.056336:0:6678:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e9881fa5c00 00000100:00100000:3.0:1787135973.061420:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135973.061526:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595470720 00000100:00100000:1.0:1787135973.061550:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595470720 00000100:00100000:1.0:1787135973.061625:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 228 00000100:00100000:1.0:1787135973.061636:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+66:11609:x1873947595470720:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787135973.117083:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+66:11609:x1873947595470720:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 Request processed in 55440us (55661us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135973.117096:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 228 00000001:00080000:3.0:1787135973.117864:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00000004:00080000:3.0:1787135973.117878:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:3.0:1787135973.117955:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:3.0:1787135973.117959:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1787135973.118134:0:5844:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1787135973.118154:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1787135973.118163:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787135973.118184:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e9849707a80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1787135973.118188:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e987c38b600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e9849707180 00000020:00080000:3.0:1787135973.118192:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e987c38b000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e9876a39800 00000020:00080000:3.0:1787135973.118222:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e9843254e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1787135973.118225:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e987c38bd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e9843254cc0 00000020:00080000:3.0:1787135973.118228:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e987c38b800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e974491e800 00000100:00100000:2.0:1787135973.119684:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974754c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616424832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787135973.119747:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135973.119811:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787135973.119818:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974754f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616424704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787135973.119841:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135973.119872:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616424832 00000100:00100000:2.0:1787135973.119878:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616424832 00000100:00100000:2.0:1787135973.119946:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616424704 00000100:00100000:2.0:1787135973.119950:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616424704 00000100:00100000:2.0:1787135973.120226:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787135973.120239:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1873947616424832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787135973.120386:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787135973.120390:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787135973 00002000:00010000:2.0:1787135973.120392:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787135973.120394:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787135972 -> 1787135973 00002000:00010000:2.0:1787135973.120397:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787135973.120438:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3301:x1873947616424832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 202us (690us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787135973.120444:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787135973.120462:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787135973.120469:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3301:x1873947616424704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787135973.120482:0:6674:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1787135973.120499:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.120518:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000056a860de/0xf5850c552f2030d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ed expref: 12 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.120527:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787135973.120532:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787135973.120536:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.120562:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000056a860de/0xf5850c552f2030d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ed expref: 12 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.120583:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000056a860de/0xf5850c552f2030d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ed expref: 12 pid: 11994 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135973.120596:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974754e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6674:1873947616424960:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787135973.120663:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984133aa80 going to sleep for 11 seconds 00000004:00080000:2.0:1787135973.120790:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e974754c000/2, rc 0, transno 4294967321 00000100:00100000:2.0:1787135973.120797:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974754c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616424832:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1787135973.120871:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787135973.121087:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1787135973.121095:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787135973.121106:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616424576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787135973.121138:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135973.122348:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616424576 00000100:00100000:2.0:1787135973.122358:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616424576 00000100:00100000:2.0:1787135973.122410:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787135973.122419:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1873947616424576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1787135973.122445:0:11994:0:(ofd_dev.c:1865:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1787135973.122475:0:11994:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8587e4, atime: 0x6a8587e4, ctime: 0x6a8587e4, blocks: 0x1 00010000:00010000:2.0:1787135973.122482:0:11994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055201035/0xf5850c552f203315 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.122496:0:11994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=333s v=(0 0) 00010000:00010000:2.0:1787135973.122500:0:11994:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787135973.122506:0:11994:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000055201035/0xf5850c552f203315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.122521:0:11994:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000055201035/0xf5850c552f203315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.122547:0:11994:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000055201035/0xf5850c552f203315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.122555:0:11994:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000055201035/0xf5850c552f203315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.122580:0:11994:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787135973.124114:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135973.124424:0:6673:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1787135973.124434:0:6673:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:0.0:1787135973.125000:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787135973.125010:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000055201035/0xf5850c552f203315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.125022:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cb200 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787135973.125027:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000055201035/0xf5850c552f203315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.125037:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000055201035/0xf5850c552f203315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.125073:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000055201035/0xf5850c552f203315 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.125080:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000055201035/0xf5850c552f203315 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.125101:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135973.125110:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135973.125112:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135973.126836:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974754e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6674:1873947616424960:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787135973.126862:0:6674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135973.127476:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595470848 00000100:00100000:3.0:1787135973.127485:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595470848 00000100:00100000:0.0:1787135973.127749:0:12502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:0.0:1787135973.127761:0:12502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2359:x1873947595470848:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787135973.131573:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3302:x1873947616424576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9147us (10426us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787135973.131587:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1787135973.131643:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e9881fa5180/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787135973.131649:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616424576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787135973.132392:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135973.132591:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595470976 00000100:00100000:1.0:1787135973.132599:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595470976 00010000:00010000:1.0:1787135973.132636:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000056a860de/0xf5850c552f2030d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ed expref: 14 pid: 11994 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135973.132679:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:1.0:1787135973.132689:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+14:2359:x1873947595470976:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787135973.132702:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787135973.132708:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000056a860de/0xf5850c552f2030d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ed expref: 14 pid: 11994 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.132722:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000056a860de/0xf5850c552f2030d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ed expref: 14 pid: 11994 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.132747:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056a860de/0xf5850c552f2030d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184ed expref: 14 pid: 11994 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.132763:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787135973.132777:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787135973.132794:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.132805:0:7612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.132831:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787135973.132876:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+13:2359:x1873947595470976:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 188us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135973.132884:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 84 00010000:00010000:0.0:1787135973.133443:0:6674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.133455:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.133465:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.133473:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.133492:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787135973.134815:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787135973.134825:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.134835:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6c00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787135973.134840:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.134849:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.134866:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.134873:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082d38c94/0xf5850c552f20330e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.134919:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135973.134921:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135973.134923:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135973.136083:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3301:x1873947616424704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15609us (16235us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1787135973.136096:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1787135973.137433:0:3301:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e974754f480/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787135973.137442:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974754f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616424704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787135973.177619:0:12502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+12:2359:x1873947595470848:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 Request processed in 49851us (53502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135973.177632:0:12502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00000001:00080000:0.0:1787135973.179785:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:0.0:1787135973.179816:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1787135973.179820:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1787135973.180702:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135973.180787:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595471232 00000100:00100000:3.0:1787135973.180797:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595471232 00000100:00100000:3.0:1787135973.180909:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 229 00000100:00100000:3.0:1787135973.180920:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:11609:x1873947595471232:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787135973.180984:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135973.181011:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896e00/0xf5850c552f2032f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718580 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.181029:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9853809700) 00010000:00010000:3.0:1787135973.181033:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787135973.181102:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20331c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.181116:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20331c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.181126:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20331c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787135973.181341:0:5823:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000008afb8bad reply state 00000000dbc4aee7 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20331c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135973.181350:0:5823:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787135973.181444:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:11609:x1873947595471232:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 526us (746us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787135973.181453:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 229 00000100:00100000:2.0:1787135973.185785:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00010000:00010000:1.0:1787135973.186230:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20331c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.186242:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20331c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.186250:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20331c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.186256:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e3800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135973.186260:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20331c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.186267:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20331c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.186282:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9853809700) 00010000:00010000:1.0:1787135973.186284:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135973.186288:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20331c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.186295:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e3800/0xf5850c552f20331c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135973.186452:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595471360 00000100:00100000:3.0:1787135973.186461:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595471360 00000100:00100000:3.0:1787135973.186541:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:3.0:1787135973.186561:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595471360:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787135973.186755:0:6673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787135973.186763:0:6673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787135973 -> 1787135972 00002000:00010000:3.0:1787135973.186766:0:6673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787135972 00002000:00010000:3.0:1787135973.186768:0:6673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787135973 -> 1787135972 00002000:00010000:3.0:1787135973.186770:0:6673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787135973.186834:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595471360:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 284us (1058us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787135973.186842:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:2.0:1787135973.189158:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135973.189240:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595471616 00000100:00100000:1.0:1787135973.189248:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595471616 00000100:00100000:1.0:1787135973.189328:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:1.0:1787135973.189339:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:11609:x1873947595471616:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787135973.189402:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.189419:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f2032dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718572 expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.189428:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.189462:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f2032dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718572 expref: 20 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.189475:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f2032dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718572 expref: 20 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135973.189489:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616425088:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787135973.189612:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f56c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135973.193465:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135973.193921:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595471744 00000100:00100000:3.0:1787135973.193931:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595471744 00010000:00010000:3.0:1787135973.193985:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f2032dd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718572 expref: 21 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135973.194025:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:3.0:1787135973.194035:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:2359:x1873947595471744:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787135973.194075:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135973.194083:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f2032dd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718572 expref: 21 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.194097:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f2032dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718572 expref: 21 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.194120:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9853809700) 00010000:00010000:3.0:1787135973.194125:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.194135:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.194159:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.194179:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135973.194239:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:2359:x1873947595471744:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 205us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135973.194248:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00010000:00010000:2.0:1787135973.195485:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f2032dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718572 expref: 20 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135973.195505:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616425088:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135973.195527:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.195536:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.195563:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.195591:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.195598:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.195605:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.195611:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae800 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135973.195616:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.195623:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.195636:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9853809700) 00010000:00010000:2.0:1787135973.195639:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787135973.195643:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.195649:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203323 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135973.195710:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:11609:x1873947595471616:12345-192.168.203.38@tcp:55:lhsmtool_posix.0 Request processed in 6372us (6742us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787135973.195719:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 230 00000100:00100000:1.0:1787135973.198415:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135973.198504:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595471872 00000100:00100000:2.0:1787135973.198514:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595471872 00000100:00100000:0.0:1787135973.198646:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:0.0:1787135973.198660:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595471872:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787135973.198703:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.198724:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71858e expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.198732:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787135973.198736:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787135973.198741:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.198776:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71858e expref: 8 pid: 6673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.198789:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71858e expref: 8 pid: 6673 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135973.198802:0:6674:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6674:1873947616425216:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135973.199180:0:6674:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aefb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787135973.206889:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135973.207538:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595472000 00000100:00100000:3.0:1787135973.207549:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595472000 00010000:00010000:3.0:1787135973.207600:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71858e expref: 9 pid: 6673 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135973.207642:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:3.0:1787135973.207651:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2360:x1873947595472000:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787135973.207665:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135973.207686:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71858e expref: 9 pid: 6673 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.207700:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71858e expref: 9 pid: 6673 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.207733:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787135973.207738:0:7612:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787135973.207743:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.207771:0:7612:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.207792:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135973.207852:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+9:2360:x1873947595472000:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 202us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135973.207860:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 86 00010000:00010000:2.0:1787135973.208394:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002b811d2f/0xf5850c552f203307 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71858e expref: 8 pid: 6673 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135973.208412:0:6674:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6674:1873947616425216:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135973.208433:0:6674:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.208445:0:6674:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.208452:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.208479:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.208487:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.208496:0:6674:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.208503:0:6674:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787135973.208507:0:6674:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.208535:0:6674:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.208559:0:6674:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.208567:0:6674:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f31d0f05/0xf5850c552f20332a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135973.208619:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2360:x1873947595471872:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 Request processed in 9963us (10211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135973.208627:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 70 00000100:00100000:2.0:1787135973.210776:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135973.210846:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595472256 00000100:00100000:0.0:1787135973.210866:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595472256 00000100:00100000:0.0:1787135973.210918:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 231 00000100:00100000:0.0:1787135973.210927:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:11609:x1873947595472256:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787135973.210999:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f203331 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.211014:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f203331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.211024:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f203331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.211237:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.211248:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032eb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718579 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.211256:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.211286:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718579 expref: 20 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.211299:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718579 expref: 20 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135973.211315:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c2f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616425344:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787135973.211387:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aefb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787135973.213942:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135973.214155:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c2f4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616425344:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787135973.214183:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135973.215301:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595472384 00000100:00100000:3.0:1787135973.215312:0:5806:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595472384 00010000:00010000:2.0:1787135973.215431:0:5806:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718579 expref: 21 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135973.215506:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:2.0:1787135973.215517:0:5806:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:2360:x1873947595472384:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787135973.215531:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135973.215538:0:5806:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032eb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718579 expref: 21 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.215570:0:5806:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718579 expref: 21 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.215591:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f2032eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718579 expref: 21 pid: 5822 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.215606:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9853809700) 00010000:00010000:2.0:1787135973.215611:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.215620:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.215627:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.215658:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787135973.215713:0:5806:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457cb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:2360:x1873947595472384:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 198us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135973.215721:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00010000:00010000:3.0:1787135973.216117:0:5822:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.216126:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787135973.216308:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1787135973.216458:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1787135973.216501:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1787135973.216592:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c120700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5822:1873947616425472:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787135973.216642:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135973.216679:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98497076c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135973.217380:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616425472 00000100:00100000:1.0:1787135973.217388:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616425472 00000100:00100000:1.0:1787135973.217430:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787135973.217438:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5822:x1873947616425472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787135973.217519:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5822:x1873947616425472:12345-0@lo:1000:mdt00_001.0 Request processed in 81us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135973.217527:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787135973.217764:0:5822:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1787135973.217779:0:5822:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1787135973.217804:0:5822:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e974754c000, transno 4294967321 00000100:00100000:3.0:1787135973.217825:0:5822:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff8e974754f480 x1873947616424704/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787135989 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787135973.217836:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c120700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5822:1873947616425472:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1787135973.218318:0:5822:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1787135973.218384:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c120700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5822:1873947616425600:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787135973.218421:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135973.218441:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98497070c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787135973.218458:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616425600 00000100:00100000:3.0:1787135973.218462:0:5827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616425600 00000100:00100000:3.0:1787135973.218485:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787135973.218491:0:5827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5822:x1873947616425600:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787135973.218642:0:5827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c120000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5822:x1873947616425600:12345-0@lo:1000:mdt00_001.0 Request processed in 150us (220us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1787135973.218650:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787135973.218680:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c120700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5822:1873947616425600:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787135973.218707:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218717:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218725:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218731:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135973.218736:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218744:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218758:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9853809700) 00010000:00010000:3.0:1787135973.218768:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135973.218773:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218779:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896600/0xf5850c552f203338 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218807:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20327b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218813:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20327b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218819:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20327b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218824:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787135973.218828:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20327b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218834:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20327b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218842:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135973.218845:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135973.218852:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203282 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71855d expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218863:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203282 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71855d expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218873:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203282 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71855d expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.218903:0:5822:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203282 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71855d expref: 23 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135973.218915:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616425728:192.168.203.38@tcp:105: 00000100:00100000:3.0:1787135973.218969:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98412edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787135973.222443:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135973.222517:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595472512 00000100:00100000:1.0:1787135973.222526:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595472512 00000100:00100000:1.0:1787135973.222588:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:1.0:1787135973.222598:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:11608:x1873947595472512:12345-192.168.203.38@tcp:49:lfs.0 00000100:00100000:1.0:1787135973.222711:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:11608:x1873947595472512:12345-192.168.203.38@tcp:49:lfs.0 Request processed in 114us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135973.222719:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 61 00000100:00100000:3.0:1787135973.224800:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5822:1873947616425728:192.168.203.38@tcp:105: 00010000:00010000:3.0:1787135973.224830:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20327b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.224841:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f20327b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135973.225237:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135973.225302:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595472768 00000100:00100000:3.0:1787135973.225309:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595472768 00000100:00100000:3.0:1787135973.225358:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 232 00000100:00100000:3.0:1787135973.225367:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c2f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:11608:x1873947595472768:12345-192.168.203.38@tcp:58:lfs.0 00000040:00080000:3.0:1787135973.225723:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1787135973.225799:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c2f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+24:11608:x1873947595472768:12345-192.168.203.38@tcp:58:lfs.0 Request processed in 432us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135973.225807:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 232 00010000:00010000:2.0:1787135973.229170:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f20333f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229193:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f20333f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229220:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f20333f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229251:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f20333f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229259:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f20333f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229265:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f20333f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229270:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cb400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135973.229274:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f20333f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229282:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f20333f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229293:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135973.229297:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787135973.229301:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f20333f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229308:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f20333f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229321:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f203331 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229327:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f203331 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229332:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f203331 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229342:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135973.229345:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f203331 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229351:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f203331 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229358:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135973.229360:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787135973.229363:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f203331 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.229368:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f203331 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135973.229570:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:11609:x1873947595472256:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 18639us (18795us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787135973.229581:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 231 00000020:00080000:2.0:1787135973.229587:0:5822:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787135973.230342:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787135973.230348:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787135973.230387:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787135973.230394:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787135973.230504:0:11666:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1873947616425856:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787135973.230572:0:11666:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9842aef780 going to sleep for 11 seconds 00000100:00100000:2.0:1787135973.238186:0:11666:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420ca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11666:1873947616425856:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787135973.239353:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135973.239431:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595473024 00000100:00100000:1.0:1787135973.239440:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595473024 00000100:00100000:1.0:1787135973.239495:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 62 00000100:00100000:1.0:1787135973.239505:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842acf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:11609:x1873947595473024:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787135973.240167:0:5824:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787135973.240277:0:5824:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1787135973.240319:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203346 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.240335:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.240347:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203346 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.240355:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203346 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.240373:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203346 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.240379:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.240392:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787135973.240467:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842acf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+25:11609:x1873947595473024:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 962us (1115us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1787135973.240475:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 62 00000020:00080000:1.0:1787135973.240480:0:5824:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787135973.240777:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787135973.240784:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203346 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.240791:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae800 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787135973.240795:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203346 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.240803:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203346 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.240815:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e9853809500) 00010000:00010000:0.0:1787135973.240818:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787135973.240822:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203346 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.240827:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f203346 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5824 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135973.240843:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135973.240844:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135973.240846:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135973.255700:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135973.255792:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595473152 00000100:00100000:3.0:1787135973.255802:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595473152 00000100:00100000:3.0:1787135973.255861:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 233 00000100:00100000:3.0:1787135973.255871:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+25:11613:x1873947595473152:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787135973.255930:0:5823:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787135973.256086:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+25:11613:x1873947595473152:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 179us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135973.256094:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 233 00000100:00100000:0.0:1787135973.264868:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135973.264945:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595473280 00000100:00100000:1.0:1787135973.264955:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595473280 00000100:00100000:1.0:1787135973.265018:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 234 00000100:00100000:1.0:1787135973.265028:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+25:11611:x1873947595473280:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787135973.265078:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135973.265098:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20334d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718595 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.265162:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203354 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.265177:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203354 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.265189:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203354 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.265214:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f20335b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.265237:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f20335b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.265245:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f20335b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.265532:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.265543:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718556 expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.265563:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.265594:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718556 expref: 26 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.265607:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718556 expref: 26 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135973.265620:0:5821:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616425984:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787135973.265688:0:5821:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787135973.267872:0:5821:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5821:1873947616425984:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787135973.267901:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787135973.269179:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135973.269274:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595473536 00000100:00100000:1.0:1787135973.269295:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595473536 00000100:00100000:1.0:1787135973.269353:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:1.0:1787135973.269363:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+27:5597:x1873947595473536:12345-192.168.203.38@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787135973.269591:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+28:5597:x1873947595473536:12345-192.168.203.38@tcp:35:ldlm_bl.0 Request processed in 229us (416us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787135973.269599:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 63 00000100:00100000:0.0:1787135973.272687:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135973.272847:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595473792 00000100:00100000:3.0:1787135973.272857:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595473792 00000100:00100000:3.0:1787135973.272918:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 235 00000100:00100000:3.0:1787135973.272928:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+28:11613:x1873947595473792:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787135973.272946:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787135973.272964:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f203369 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71859c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.273416:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f203370 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.273432:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f203370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.273444:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f203370 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135973.273455:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787135973.273610:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2200/0xf5850c552f203369 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71859c expref: 31 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.273630:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f203370 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71859c expref: 30 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.273640:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135973.273643:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787135973.273646:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.273654:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.273661:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98413cb400, rc 0) 00000100:00100000:2.0:1787135973.273722:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+30:11613:x1873947595473792:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 796us (1042us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787135973.273730:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 235 00000100:00100000:3.0:1787135973.276874:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135973.276953:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595474048 00000100:00100000:2.0:1787135973.276962:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595474048 00000100:00100000:2.0:1787135973.277026:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 236 00000100:00100000:2.0:1787135973.277036:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+30:11613:x1873947595474048:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787135973.277138:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20337e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.277155:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20337e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.277165:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20337e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.277375:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20337e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.277383:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20337e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.277390:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20337e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.277397:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cb600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787135973.277401:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20337e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.277410:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20337e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.277421:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135973.277423:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787135973.277428:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20337e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.277434:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20337e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787135973.277581:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+31:11613:x1873947595474048:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 545us (713us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1787135973.277591:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 236 00000040:00080000:3.0:1787135973.277918:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787135973.277923:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787135973.278444:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787135973.278472:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787135973.282157:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135973.282221:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135973.282318:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595474432 00000100:00100000:2.0:1787135973.282329:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595474432 00000100:00100000:2.0:1787135973.282378:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:2.0:1787135973.282401:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+31:11613:x1873947595474432:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787135973.282626:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:11613:x1873947595474432:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 227us (404us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1787135973.282635:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 64 00000100:00100000:3.0:1787135973.283410:0:7612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595474176 00000100:00100000:3.0:1787135973.283418:0:7612:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595474176 00010000:00010000:3.0:1787135973.283445:0:7612:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718556 expref: 32 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787135973.283478:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:3.0:1787135973.283485:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:2360:x1873947595474176:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787135973.283496:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135973.283502:0:7612:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718556 expref: 32 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.283528:0:7612:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718556 expref: 32 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.283549:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20326d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718556 expref: 32 pid: 5821 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.283575:0:7612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135973.283580:0:7612:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.283588:0:7612:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.283595:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135973.283616:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135973.283645:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+31:2360:x1873947595474176:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 161us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135973.283652:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 88 00010000:00010000:1.0:1787135973.283991:0:5821:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284000:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787135973.284038:0:5821:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787135973.284042:0:5821:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787135973.284089:0:5821:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284101:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284109:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203354 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284114:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203354 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284120:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203354 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284136:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afc00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135973.284140:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203354 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284146:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203354 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284155:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:1.0:1787135973.284158:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135973.284161:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203354 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284166:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f203354 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284176:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f20335b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284181:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f20335b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284186:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f20335b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284191:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135973.284194:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f20335b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284199:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f20335b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284226:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e9853809900) 00010000:00010000:1.0:1787135973.284228:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787135973.284232:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f20335b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284238:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f20335b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5821 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284269:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20334d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718595 expref: 31 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284286:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718595 expref: 30 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135973.284294:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:1.0:1787135973.284296:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787135973.284299:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533afa00, rc 0) 00000100:00100000:1.0:1787135973.284338:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+30:11611:x1873947595473280:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 19312us (19480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135973.284346:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 234 00010000:00010000:1.0:1787135973.467087:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787135973.860272:0:12540:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787135973.860280:0:12540:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787135973.860319:0:12540:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787135973.860340:0:12540:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787135973.987829:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135973.987869:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595474688 00000100:00100000:2.0:1787135973.987878:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595474688 00000100:00100000:2.0:1787135973.987927:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 237 00000100:00100000:2.0:1787135973.987937:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+30:11635:x1873947595474688:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:2.0:1787135973.987962:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787135973.987982:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cae00/0xf5850c552f203385 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7185a3 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.988088:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20338c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.988106:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20338c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.988117:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20338c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5823 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787135973.988127:0:5823:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787135973.988255:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cae00/0xf5850c552f203385 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185a3 expref: 33 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.988272:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20338c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185a3 expref: 32 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135973.988423:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:2.0:1787135973.988427:0:5823:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787135973.988431:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98413cb600, rc 0) 00000100:00100000:2.0:1787135973.988515:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:11635:x1873947595474688:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 580us (696us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1787135973.988523:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 237 00000100:00100000:0.0:1787135974.004112:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135974.006230:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595474816 00000100:00100000:1.0:1787135974.006243:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595474816 00000100:00100000:1.0:1787135974.006489:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 238 00000100:00100000:1.0:1787135974.006500:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:11635:x1873947595474816:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:1.0:1787135974.006563:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20339a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135974.006590:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20339a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135974.006601:0:7623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20339a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135974.006626:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20339a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135974.006633:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20339a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135974.006639:0:7623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20339a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135974.006644:0:7623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afe00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787135974.006648:0:7623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20339a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135974.006655:0:7623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20339a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135974.006665:0:7623:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:1.0:1787135974.006668:0:7623:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787135974.006672:0:7623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20339a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135974.006678:0:7623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afe00/0xf5850c552f20339a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7623 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787135974.006753:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:11635:x1873947595474816:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 255us (2647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135974.006767:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 238 00000100:00100000:2.0:1787135974.099043:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135974.100645:0:12502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595474944 00000100:00100000:1.0:1787135974.100668:0:12502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595474944 00000100:00100000:1.0:1787135974.100734:0:12502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:1.0:1787135974.100745:0:12502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2359:x1873947595474944:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:1.0:1787135974.100764:0:12502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787135974.100783:0:12502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033d334d2/0xf5850c552f2033a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7185aa expref: -99 pid: 12502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787135974.100809:0:12502:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8587e4, atime: 0x6a8587e4, ctime: 0x6a8587e4, blocks: 0xb 00010000:00010000:1.0:1787135974.100830:0:12502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1787135974.100834:0:12502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787135974.100842:0:12502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033d334d2/0xf5850c552f2033a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185aa expref: 8 pid: 12502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135974.100860:0:12502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033d334d2/0xf5850c552f2033a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185aa expref: 8 pid: 12502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787135974.100873:0:12502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533afe00, rc 0) 00000100:00100000:1.0:1787135974.100935:0:12502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2359:x1873947595474944:12345-192.168.203.38@tcp:101:cat.0 Request processed in 191us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135974.100942:0:12502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 71 00000100:00100000:2.0:1787135974.106188:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135974.106680:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595475072 00000100:00100000:3.0:1787135974.106691:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595475072 00002000:00100000:3.0:1787135974.106785:0:6679:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8e974754c380 x1873947595475072/t0(0) o3->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:400/0 lens 488/0 e 0 to 0 dl 1787135985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787135974.106817:0:6679:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e974754c380 with x1873947595475072 ext(0->4095) 00002000:00010000:3.0:1787135974.106824:0:6679:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e974754c380 00000100:00100000:3.0:1787135974.106865:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:3.0:1787135974.106873:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974754c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595475072:12345-192.168.203.38@tcp:3:cat.0 00000100:00100000:3.0:1787135974.107146:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974754c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2360:x1873947595475072:12345-192.168.203.38@tcp:3:cat.0 Request processed in 272us (965us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787135974.107153:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00002000:00100000:3.0:1787135974.107160:0:6679:0:(ofd_dev.c:2712:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8e974754c380 x1873947595475072/t0(0) o3->a1006dc5-9c90-4762-af1c-1ab0be9a05b8@192.168.203.38@tcp:400/0 lens 488/4536 e 0 to 0 dl 1787135985 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787135974.107168:0:6679:0:(ofd_dev.c:2568:ofd_prolong_extent_locks()) Prolong locks for req ffff8e974754c380 with x1873947595475072 ext(0->4095) 00002000:00010000:3.0:1787135974.107172:0:6679:0:(ofd_dev.c:2717:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8e974754c380 00010000:00010000:0.0:1787135974.488548:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135975.515447:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135976.299998:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135976.300030:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135976.300086:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135976.300109:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135976.300150:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135976.300258:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595475200 00000100:00100000:1.0:1787135976.300269:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595475200 00000100:00100000:1.0:1787135976.300323:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 294 00000100:00100000:1.0:1787135976.300339:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:2362:x1873947595475200:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135976.300735:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595475456 00000100:00100000:2.0:1787135976.300739:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595475456 00000100:00100000:2.0:1787135976.300787:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595475584 00000100:00100000:2.0:1787135976.300791:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595475584 00000100:00100000:2.0:1787135976.300814:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:2.0:1787135976.300821:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2362:x1873947595475456:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135976.300858:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842bf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2362:x1873947595475456:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 38us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135976.300865:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:2.0:1787135976.300892:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:2.0:1787135976.300900:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2362:x1873947595475584:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135976.300927:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+8:2362:x1873947595475584:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135976.300933:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00080000:3.0:1787135976.301349:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787135976.301354:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787135976.301614:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:2362:x1873947595475200:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 72us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135976.301625:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 294 00000100:00100000:1.0:1787135976.301672:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595475712 00000100:00100000:1.0:1787135976.301676:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595475712 00000100:00100000:1.0:1787135976.301722:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595475328 00000100:00100000:1.0:1787135976.301725:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595475328 00000100:00100000:1.0:1787135976.301740:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:1.0:1787135976.301746:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2362:x1873947595475712:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135976.301782:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2362:x1873947595475712:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 35us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135976.301789:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 153 00000100:00100000:1.0:1787135976.301800:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 154 00000100:00100000:1.0:1787135976.301807:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98738da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:2362:x1873947595475328:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135976.301831:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98738da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+32:2362:x1873947595475328:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (1722us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135976.301837:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 154 00000100:00080000:3.0:1787135976.302169:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787135976.470339:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1787135976.470358:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:1.0:1787135976.536362:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135977.432361:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787135977.432475:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616426112:0@lo:400:kworker.0 00000100:00100000:0.0:1787135977.432555:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135977.432608:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787135977.432614:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616426240:0@lo:400:kworker.0 00000100:00100000:0.0:1787135977.432658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135977.432693:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616426112 00000100:00100000:0.0:1787135977.432700:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616426112 00000100:00100000:0.0:1787135977.432740:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787135977.432748:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616426112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135977.432810:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616426112:12345-0@lo:400:kworker.0 Request processed in 62us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135977.432818:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1787135977.432862:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616426112:0@lo:400:kworker.0 00000100:00100000:0.0:1787135977.432964:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c1fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616426624:0@lo:400:kworker.0 00000100:00100000:0.0:1787135977.432990:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135977.433022:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787135977.433028:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616426752:0@lo:400:kworker.0 00000100:00100000:0.0:1787135977.433081:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135977.433115:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616426752 00000100:00100000:0.0:1787135977.433119:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616426752 00000100:00100000:0.0:1787135977.433171:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787135977.433189:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1873947616426752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135977.433227:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1873947616426752:12345-0@lo:400:kworker.0 Request processed in 49us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135977.433234:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787135977.433260:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616426752:0@lo:400:kworker.0 00000100:00100000:2.0:1787135977.433688:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c1fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616426496:0@lo:400:kworker.0 00000100:00100000:2.0:1787135977.433723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135977.433746:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616426368:0@lo:400:kworker.0 00000100:00100000:2.0:1787135977.433766:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135977.433851:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616426240 00000100:00100000:1.0:1787135977.433856:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616426240 00000100:00100000:1.0:1787135977.433901:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616426624 00000100:00100000:1.0:1787135977.433904:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616426624 00000100:00100000:1.0:1787135977.433919:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616426368 00000100:00100000:1.0:1787135977.433922:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616426368 00000100:00100000:1.0:1787135977.433948:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787135977.433954:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c1ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616426240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135977.433997:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c1ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616426240:12345-0@lo:400:kworker.0 Request processed in 43us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135977.434004:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787135977.434016:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787135977.434023:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98606d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616426624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135977.434256:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98606d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616426624:12345-0@lo:400:kworker.0 Request processed in 233us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135977.434263:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787135977.434276:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787135977.434282:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616426368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135977.434314:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616426368:12345-0@lo:400:kworker.0 Request processed in 32us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135977.434320:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787135977.434356:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c1fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616426624:0@lo:400:kworker.0 00000100:00100000:1.0:1787135977.434367:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616426240:0@lo:400:kworker.0 00000100:00080000:3.0:1787135977.435452:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787135977.435460:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787135977.437283:0:11994:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616426496 00000100:00100000:0.0:1787135977.437297:0:11994:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616426496 00000100:00100000:0.0:1787135977.437437:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787135977.437448:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616426496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135977.437684:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616426496:12345-0@lo:400:kworker.0 Request processed in 237us (3957us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135977.437692:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1787135977.437789:0:3301:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787135977.437796:0:3301:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1787135977.437811:0:3301:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e9881fa5180, transno 4294967310 00000100:00100000:2.0:1787135977.437830:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c1fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616426496:0@lo:400:kworker.0 00000100:00100000:2.0:1787135977.437845:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616426368:0@lo:400:kworker.0 00000100:00080000:3.0:1787135977.438553:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787135977.561254:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135977.945231:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787135977.945255:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616426880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135977.945321:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135977.945424:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616426880 00000100:00100000:2.0:1787135977.945432:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616426880 00000100:00100000:2.0:1787135977.945481:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787135977.945490:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1873947616426880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787135977.945532:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135977.945579:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3301:x1873947616426880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135977.945587:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787135977.945732:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616426880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135977.945974:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616427008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787135977.946006:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135977.946133:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616427008 00000100:00100000:2.0:1787135977.946138:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616427008 00000100:00100000:2.0:1787135977.946170:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787135977.946187:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616427008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787135977.946209:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135977.946735:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987467f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616427008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 547us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135977.946743:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787135977.954725:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616427008:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1787135978.547075:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000020:00080000:3.0:1787135978.547090:0:5844:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:3.0:1787135978.547103:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000001:00080000:3.0:1787135978.547113:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787135978.547129:0:5844:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e9849707240 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787135978.547134:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e987c130f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e984305da80 00000020:00080000:3.0:1787135978.547137:0:5844:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff8e987c130c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e9842bbd000 00000020:00080000:3.0:1787135978.547186:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1787135978.547358:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1787135978.561791:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1787135978.561804:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1787135978.561816:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:0.0:1787135978.589522:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135978.616508:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135978.618586:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595475840 00000100:00100000:1.0:1787135978.618602:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595475840 00000100:00100000:2.0:1787135978.618755:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 239 00000100:00100000:2.0:1787135978.618767:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:11288:x1873947595475840:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1787135978.618815:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135978.618893:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:11288:x1873947595475840:12345-192.168.203.38@tcp:60:lhsmtool_posix.0 Request processed in 128us (2393us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135978.618900:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 239 00000100:00100000:1.0:1787135978.621221:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135978.621487:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595476096 00000100:00100000:2.0:1787135978.621497:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595476096 00000100:00100000:2.0:1787135978.621550:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:2.0:1787135978.621560:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:11288:x1873947595476096:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787135978.622027:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:11288:x1873947595476096:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 466us (813us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1787135978.622035:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 65 00000100:00100000:3.0:1787135978.839421:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135978.839534:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595476224 00000100:00100000:0.0:1787135978.839544:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595476224 00000100:00100000:0.0:1787135978.839620:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 240 00000100:00100000:0.0:1787135978.839630:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:12087:x1873947595476224:12345-192.168.203.38@tcp:101:lsof.0 00010000:00010000:0.0:1787135978.839659:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787135978.839724:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2033a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7185b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135978.839785:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2033af lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135978.839798:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2033af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135978.839810:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2033af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787135978.840087:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787135978.840338:0:5822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787135978.840343:0:5822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787135978.840427:0:5822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2033af lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135978.840456:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f2033a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185b1 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135978.840473:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2033af lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185b1 expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135978.840482:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:0.0:1787135978.840485:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787135978.840497:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896200, rc 0) 00000100:00100000:0.0:1787135978.840567:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:12087:x1873947595476224:12345-192.168.203.38@tcp:101:lsof.0 Request processed in 938us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135978.840575:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 240 00010000:00010000:1.0:1787135979.612268:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787135980.440442:0:11666:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787135980.440451:0:11666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787135980.440868:0:11666:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1787135980.440876:0:11666:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787135980.632201:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135981.420330:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135981.420372:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135981.420691:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595476352 00000100:00100000:1.0:1787135981.420702:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595476352 00000100:00100000:1.0:1787135981.420757:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 296 00000100:00100000:1.0:1787135981.420768:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:2361:x1873947595476352:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135981.421196:0:12502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595476608 00000100:00100000:2.0:1787135981.421202:0:12502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595476608 00000100:00100000:2.0:1787135981.421265:0:12502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:2.0:1787135981.421274:0:12502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2361:x1873947595476608:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:0.0:1787135981.421334:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787135981.425107:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+13:2361:x1873947595476352:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 4330us (4774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135981.425123:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 296 00000100:00100000:3.0:1787135981.425699:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135981.425873:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135981.425897:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135981.425928:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595476736 00000100:00100000:3.0:1787135981.425936:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595476736 00000100:00100000:3.0:1787135981.425988:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:3.0:1787135981.425998:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2361:x1873947595476736:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787135981.426080:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c122a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2361:x1873947595476736:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 83us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135981.426088:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00080000:3.0:1787135981.426105:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787135981.427289:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595476864 00000100:00100000:1.0:1787135981.427299:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595476864 00000100:00100000:1.0:1787135981.427356:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595476480 00000100:00100000:1.0:1787135981.427360:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595476480 00000100:00100000:1.0:1787135981.427386:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:1.0:1787135981.427395:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2361:x1873947595476864:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135981.427463:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2361:x1873947595476864:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 56us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135981.427471:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 158 00000100:00100000:1.0:1787135981.427486:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00100000:1.0:1787135981.427493:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:2361:x1873947595476480:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787135981.428221:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c121880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:2361:x1873947595476480:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 726us (2345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135981.428230:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 159 00000100:00080000:3.0:1787135981.428829:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135981.437347:0:12502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c121f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2361:x1873947595476608:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 16062us (16960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135981.437366:0:12502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 95 00010000:00010000:1.0:1787135981.656428:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135982.553691:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616427264:0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.553760:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135982.553809:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616427776:0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.553847:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135982.553874:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787135982.553880:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616427136:0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.553907:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135982.553927:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616427648:0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.553946:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135982.553971:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616427392:0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.553992:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135982.554009:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787135982.554014:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616427520:0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.554034:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135982.554094:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616427264 00000100:00100000:0.0:1787135982.554101:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616427264 00000100:00100000:0.0:1787135982.554383:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616427648 00000100:00100000:0.0:1787135982.554397:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616427648 00000100:00100000:0.0:1787135982.554424:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616427392 00000100:00100000:0.0:1787135982.554428:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616427392 00000100:00100000:0.0:1787135982.554444:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787135982.554451:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616427264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.554518:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616427264:12345-0@lo:400:kworker.0 Request processed in 66us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135982.554526:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787135982.554544:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787135982.554551:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616427648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.554581:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616427648:12345-0@lo:400:kworker.0 Request processed in 31us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135982.554587:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1787135982.554598:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787135982.554605:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616427392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.554636:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616427392:12345-0@lo:400:kworker.0 Request processed in 32us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135982.554642:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787135982.554660:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616427136 00000100:00100000:0.0:1787135982.554664:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616427136 00000100:00100000:0.0:1787135982.554686:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787135982.554692:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616427136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.554716:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616427136:12345-0@lo:400:kworker.0 Request processed in 25us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135982.554722:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1787135982.554752:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616427776 00000100:00100000:0.0:1787135982.554755:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616427776 00000100:00100000:0.0:1787135982.554787:0:6672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616427520 00000100:00100000:0.0:1787135982.554790:0:6672:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616427520 00000100:00100000:0.0:1787135982.554809:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787135982.554815:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616427776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.554959:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616427776:12345-0@lo:400:kworker.0 Request processed in 142us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135982.554965:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787135982.554977:0:6672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787135982.554983:0:6672:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616427520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.555013:0:6672:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616427520:12345-0@lo:400:kworker.0 Request processed in 30us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135982.555018:0:6672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1787135982.555037:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787135982.555041:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787135982.555043:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787135982.555201:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616427520:0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.555216:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616427392:0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.555247:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616427136:0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.555256:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616427648:0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.555264:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616427264:0@lo:400:kworker.0 00000100:00100000:0.0:1787135982.555272:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787135982.555276:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e974754f480, transno 4294967322 00000004:00080000:0.0:1787135982.555286:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1787135982.555302:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616427776:0@lo:400:kworker.0 00000001:02000400:2.0:1787135982.568687:0:12744:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 06:39:41 (1787135981) 00010000:00010000:2.0:1787135982.681425:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135983.065255:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616427904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135983.065342:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135983.065472:0:9726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616427904 00000100:00100000:3.0:1787135983.065481:0:9726:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616427904 00000100:00100000:3.0:1787135983.065534:0:9726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787135983.065543:0:9726:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616427904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787135983.065576:0:9726:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135983.065623:0:9726:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616427904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135983.065631:0:9726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787135983.065673:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c123100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616427904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135983.066798:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616428032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787135983.066859:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135983.066934:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616428032 00000100:00100000:1.0:1787135983.066941:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616428032 00000100:00100000:1.0:1787135983.066984:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787135983.066993:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616428032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787135983.067020:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787135983.079101:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616428032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12099us (12230us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135983.079130:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787135983.080958:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616428032:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1787135983.651574:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787135983.651590:0:5844:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1787135983.651635:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1787135983.651646:0:5855:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1787135983.707811:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135984.728962:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135985.756342:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135986.053179:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135986.053261:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595477120 00000100:00100000:2.0:1787135986.053272:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595477120 00000100:00100000:2.0:1787135986.053354:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00100000:2.0:1787135986.053363:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+19:12308:x1873947595477120:12345-192.168.203.38@tcp:35:umount.0 00000100:00100000:2.0:1787135986.053882:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:12308:x1873947595477120:12345-192.168.203.38@tcp:35:umount.0 Request processed in 518us (709us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1787135986.053891:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 66 00000100:00080000:0.0:1787135986.054488:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135986.060988:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135986.063218:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595477376 00000100:00100000:2.0:1787135986.063234:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595477376 00000100:00100000:2.0:1787135986.063311:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:2.0:1787135986.063323:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+20:12308:x1873947595477376:12345-192.168.203.38@tcp:35:umount.0 00000100:00100000:2.0:1787135986.067524:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:12308:x1873947595477376:12345-192.168.203.38@tcp:35:umount.0 Request processed in 4194us (6532us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787135986.067536:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 67 00000100:00100000:3.0:1787135986.074355:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135986.075526:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595477632 00000100:00100000:1.0:1787135986.075538:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595477632 00000100:00100000:1.0:1787135986.075600:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:1.0:1787135986.075610:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842acc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+21:12308:x1873947595477632:12345-192.168.203.38@tcp:35:umount.0 00000100:00100000:1.0:1787135986.076280:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842acc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:12308:x1873947595477632:12345-192.168.203.38@tcp:35:umount.0 Request processed in 669us (1931us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1787135986.076290:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 68 00000100:00100000:1.0:1787135986.087495:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135986.087856:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595477888 00000100:00100000:2.0:1787135986.087867:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595477888 00000100:00100000:2.0:1787135986.087926:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:2.0:1787135986.087936:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:12308:x1873947595477888:12345-192.168.203.38@tcp:35:umount.0 00000100:00100000:2.0:1787135986.088326:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:12308:x1873947595477888:12345-192.168.203.38@tcp:35:umount.0 Request processed in 389us (838us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1787135986.088335:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 69 00000100:00100000:3.0:1787135986.099344:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135986.099383:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135986.099413:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135986.099502:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595478016 00000100:00100000:0.0:1787135986.099511:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595478016 00000100:00100000:0.0:1787135986.099572:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595478272 00000100:00100000:0.0:1787135986.099575:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595478272 00000100:00100000:0.0:1787135986.099589:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595478144 00000100:00100000:0.0:1787135986.099591:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595478144 00000100:00100000:0.0:1787135986.099605:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:0.0:1787135986.099614:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccb52158-7d35-4065-a26d-1bb142899404+15:2362:x1873947595478016:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135986.099628:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135986.099647:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841488600/0xf5850c552f2023be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718135 expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135986.099664:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135986.099724:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c123100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccb52158-7d35-4065-a26d-1bb142899404+14:2362:x1873947595478016:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 111us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135986.099731:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:0.0:1787135986.099748:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:0.0:1787135986.099753:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c120700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccb52158-7d35-4065-a26d-1bb142899404+13:2362:x1873947595478272:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135986.099773:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135986.099783:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98533ae200/0xf5850c552f202634 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718200 expref: 13 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135986.099810:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135986.099841:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c120700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccb52158-7d35-4065-a26d-1bb142899404+12:2362:x1873947595478272:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 87us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135986.099847:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:0.0:1787135986.099859:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:0.0:1787135986.099865:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccb52158-7d35-4065-a26d-1bb142899404+11:2362:x1873947595478144:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787135986.099872:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135986.099881:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9841488000/0xf5850c552f202386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7180fd expref: 11 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135986.099889:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135986.099905:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ccb52158-7d35-4065-a26d-1bb142899404+10:2362:x1873947595478144:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 40us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135986.099912:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:3.0:1787135986.105381:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787135986.105790:0:12502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595478656 00000100:00100000:2.0:1787135986.105800:0:12502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595478656 00000100:00100000:2.0:1787135986.105906:0:12502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:2.0:1787135986.105918:0:12502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+7:2358:x1873947595478656:12345-192.168.203.38@tcp:9:umount.0 00000020:00000080:2.0:1787135986.105947:0:12502:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202960 00000020:00010000:2.0:1787135986.105955:0:12502:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e9851517800: total 0 00000100:00080000:2.0:1787135986.105971:0:12502:0:(import.c:65:import_set_state_nolock()) ffff8e984564a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787135986.106017:0:12502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:3.0:1787135986.106027:0:5809:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e9851517800: total 0 00010000:00010000:3.0:1787135986.106096:0:5809:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e9851517800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1787135986.106167:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033d334d2/0xf5850c552f2033a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185aa expref: 6 pid: 12502 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.106207:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f780e215/0xf5850c552f202d03 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183dc expref: 5 pid: 6673 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.106225:0:5809:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e9851517800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1787135986.106240:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135986.106242:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135986.106244:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135986.106336:0:12502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+2:2358:x1873947595478656:12345-192.168.203.38@tcp:9:umount.0 Request processed in 419us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135986.106345:0:12502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 72 00000100:00100000:3.0:1787135986.110809:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135986.110912:0:6673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595478784 00000100:00100000:1.0:1787135986.110921:0:6673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595478784 00000100:00080000:0.0:1787135986.111028:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787135986.111033:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787135986.114147:0:6673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 73 00000100:00100000:1.0:1787135986.114165:0:6673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+5:2358:x1873947595478784:12345-192.168.203.38@tcp:9:umount.0 00000020:00000080:1.0:1787135986.114197:0:6673:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f2026f8 00000100:00080000:1.0:1787135986.114207:0:6673:0:(import.c:65:import_set_state_nolock()) ffff8e9876b32800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787135986.114245:0:6673:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787135986.114511:0:6673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+2:2358:x1873947595478784:12345-192.168.203.38@tcp:9:umount.0 Request processed in 351us (3708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135986.114519:0:6673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 73 00010000:00010000:1.0:1787135986.114541:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135986.130228:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135986.130333:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595479808 00000100:00100000:0.0:1787135986.130342:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595479808 00000100:00100000:0.0:1787135986.130404:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 241 00000100:00100000:0.0:1787135986.130415:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+23:2358:x1873947595479808:12345-192.168.203.38@tcp:39:umount.0 00000020:00000080:0.0:1787135986.130456:0:7623:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202394 00000020:00010000:0.0:1787135986.130482:0:7623:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e9746920000: total 0 00000100:00080000:0.0:1787135986.130487:0:7623:0:(import.c:65:import_set_state_nolock()) ffff8e984758e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787135986.130513:0:7623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1787135986.130892:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a1006dc5-9c90-4762-af1c-1ab0be9a05b8+22:2358:x1873947595479808:12345-192.168.203.38@tcp:39:umount.0 Request processed in 478us (671us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1787135986.130919:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 241 00000020:00010000:3.0:1787135986.131656:0:5809:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e9746920000: total 0 00010000:00010000:3.0:1787135986.131664:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135986.131705:0:5809:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e9746920000, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1787135986.131778:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135986.131782:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787135986.131800:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb400/0xf5850c552f203370 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71859c expref: 21 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.131832:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:3.0:1787135986.131835:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787135986.131839:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f202d81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183ff expref: 20 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.131852:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:3.0:1787135986.131855:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135986.131858:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f202be4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71838f expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.131868:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135986.131871:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787135986.131874:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203282 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71855d expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.131885:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:3.0:1787135986.131887:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787135986.131891:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2026ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71822a expref: 17 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.131902:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e98532d1800) 00010000:00010000:3.0:1787135986.131904:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787135986.131908:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f20265e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71820e expref: 16 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.131926:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:3.0:1787135986.131935:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787135986.131940:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896400/0xf5850c552f202d65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183f8 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.131955:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:3.0:1787135986.131957:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787135986.131960:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9840030a00/0xf5850c552f202cee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183d5 expref: 14 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.131972:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135986.131975:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787135986.131979:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203362 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718595 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.131991:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e98532d1a00) 00010000:00010000:3.0:1787135986.131993:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787135986.131996:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98413cb600/0xf5850c552f20338c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185a3 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.132011:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e98532d1e00) 00010000:00010000:3.0:1787135986.132014:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787135986.132017:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897c00/0xf5850c552f202cc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7183c7 expref: 11 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.132030:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e98532d1500) 00010000:00010000:3.0:1787135986.132033:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787135986.132036:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f2029c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718303 expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.132100:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e9853809600) 00010000:00010000:3.0:1787135986.132103:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787135986.132108:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af000/0xf5850c552f20267a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718215 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.132132:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e98532d1300) 00010000:00010000:3.0:1787135986.132135:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787135986.132139:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98820e2400/0xf5850c552f203060 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7184d1 expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135986.132152:0:5809:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e9746920000, canceled 14 locks, left on hash table 0. 00010000:00010000:3.0:1787135986.132165:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135986.132167:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135986.132169:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787135986.535844:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135986.535916:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135986.535939:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595480064 00000100:00100000:0.0:1787135986.535951:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595480064 00000100:00100000:0.0:1787135986.536026:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 163 00000100:00100000:0.0:1787135986.536038:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2360:x1873947595480064:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787135986.536155:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2360:x1873947595480064:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 119us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135986.536162:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 163 00000100:00080000:3.0:1787135986.536232:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787135986.537599:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595479936 00000100:00100000:2.0:1787135986.537610:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595479936 00000100:00100000:2.0:1787135986.537680:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 298 00000100:00100000:2.0:1787135986.537690:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98436b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:2360:x1873947595479936:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787135986.537747:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98436b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ccb52158-7d35-4065-a26d-1bb142899404+10:2360:x1873947595479936:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 59us (1830us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135986.537755:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 298 00000001:00100000:3.0:1787135986.733454:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000020:00000080:3.0:1787135986.733463:0:6697:0:(genops.c:906:class_export_put()) final put ffff8e9876b37000/a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000020:00000080:0.0:1787135986.733676:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9876b37000/a1006dc5-9c90-4762-af1c-1ab0be9a05b8 for lustre-OST0000 00000020:00000080:0.0:1787135986.733730:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9876b32800 for lustre-OST0000 00010000:00010000:1.0:1787135986.776265:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135987.674583:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616428544:0@lo:400:kworker.0 00000100:00100000:0.0:1787135987.674647:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135987.674717:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787135987.674724:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616428416:0@lo:400:kworker.0 00000100:00100000:0.0:1787135987.674750:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135987.674781:0:7623:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616428416 00000100:00100000:0.0:1787135987.674787:0:7623:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616428416 00000100:00100000:0.0:1787135987.674848:0:7623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787135987.674858:0:7623:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616428416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787135987.674910:0:7623:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616428416:12345-0@lo:400:kworker.0 Request processed in 53us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135987.674919:0:7623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787135987.674957:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616428416:0@lo:400:kworker.0 00000100:00080000:3.0:1787135987.675152:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787135987.675214:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616428288:0@lo:400:kworker.0 00000100:00100000:1.0:1787135987.675243:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135987.675271:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616428800:0@lo:400:kworker.0 00000100:00100000:1.0:1787135987.675291:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135987.675328:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787135987.675333:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616428160:0@lo:400:kworker.0 00000100:00100000:1.0:1787135987.675361:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135987.675384:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616428672:0@lo:400:kworker.0 00000100:00100000:1.0:1787135987.675405:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787135987.675429:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616428160 00000100:00100000:1.0:1787135987.675433:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616428160 00000100:00100000:1.0:1787135987.675460:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787135987.675467:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616428160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135987.675501:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616428160:12345-0@lo:400:kworker.0 Request processed in 34us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135987.675507:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787135987.675535:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616428288 00000100:00100000:1.0:1787135987.675538:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616428288 00000100:00100000:1.0:1787135987.675558:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616428672 00000100:00100000:1.0:1787135987.675560:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616428672 00000100:00100000:1.0:1787135987.675577:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787135987.675584:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616428288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787135987.675613:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616428288:12345-0@lo:400:kworker.0 Request processed in 29us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135987.675619:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787135987.675644:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787135987.675649:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616428672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135987.675808:0:12502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616428544 00000100:00100000:3.0:1787135987.675813:0:12502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616428544 00000100:00100000:3.0:1787135987.675843:0:12502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616428800 00000100:00100000:3.0:1787135987.675846:0:12502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616428800 00000100:00100000:3.0:1787135987.675863:0:12502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787135987.675871:0:12502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616428544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135987.675909:0:12502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616428544:12345-0@lo:400:kworker.0 Request processed in 38us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135987.675916:0:12502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787135987.675934:0:12502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787135987.675941:0:12502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616428800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787135987.675969:0:12502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616428800:12345-0@lo:400:kworker.0 Request processed in 29us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135987.675976:0:12502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:3.0:1787135987.675989:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787135987.675992:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787135987.675994:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787135987.676017:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616428544:0@lo:400:kworker.0 00000100:00100000:3.0:1787135987.676087:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616428160:0@lo:400:kworker.0 00000100:00100000:3.0:1787135987.676097:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616428288:0@lo:400:kworker.0 00000100:00100000:3.0:1787135987.676116:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616428800:0@lo:400:kworker.0 00000100:00100000:1.0:1787135987.676412:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1873947616428672:12345-0@lo:400:kworker.0 Request processed in 761us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787135987.676420:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787135987.676446:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3303:1873947616428672:0@lo:400:kworker.0 00010000:00010000:3.0:1787135987.800213:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135988.184395:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616428928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135988.184475:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135988.184596:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616428928 00000100:00100000:3.0:1787135988.184604:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616428928 00000100:00100000:3.0:1787135988.184654:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787135988.184664:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616428928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787135988.184697:0:6677:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787135988.184738:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616428928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135988.184744:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787135988.184825:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616428928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787135988.184843:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787135988.184848:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616429056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787135988.184882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787135988.185245:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616429056 00000100:00100000:2.0:1787135988.185250:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616429056 00000100:00100000:2.0:1787135988.185285:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787135988.185292:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616429056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787135988.185312:0:6676:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787135988.185360:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616429056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135988.185373:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787135988.185397:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616429056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787135988.303758:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135988.303798:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787135988.303833:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135988.303893:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595480192 00000100:00100000:3.0:1787135988.303903:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595480192 00000100:00100000:3.0:1787135988.303965:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595480448 00000100:00100000:3.0:1787135988.303968:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595480448 00000100:00100000:3.0:1787135988.303981:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595480320 00000100:00100000:3.0:1787135988.303997:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595480320 00000100:00100000:2.0:1787135988.304027:0:7612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:3.0:1787135988.304036:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:2.0:1787135988.304043:0:7612:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccb52158-7d35-4065-a26d-1bb142899404+12:2361:x1873947595480192:12345-192.168.203.38@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787135988.304079:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccb52158-7d35-4065-a26d-1bb142899404+12:2361:x1873947595480448:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787135988.304095:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787135988.304096:0:7612:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135988.304130:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98533af600/0xf5850c552f20262d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7181f9 expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135988.304131:0:7612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511da800/0xf5850c552f202466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71814a expref: 12 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135988.304155:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787135988.304166:0:7612:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135988.304219:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccb52158-7d35-4065-a26d-1bb142899404+10:2361:x1873947595480448:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 175us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135988.304226:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:3.0:1787135988.304254:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:3.0:1787135988.304261:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98457c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccb52158-7d35-4065-a26d-1bb142899404+9:2361:x1873947595480320:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787135988.304268:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135988.304279:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511dba00/0xf5850c552f20246d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718174 expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135988.304287:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135988.319204:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98457c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ccb52158-7d35-4065-a26d-1bb142899404+8:2361:x1873947595480320:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 14929us (15355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135988.319212:0:7612:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ccb52158-7d35-4065-a26d-1bb142899404+8:2361:x1873947595480192:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 15153us (15440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135988.319221:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:3.0:1787135988.319311:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787135988.319344:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595480704 00000100:00100000:2.0:1787135988.319352:0:7612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:3.0:1787135988.319354:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595480704 00000100:00100000:3.0:1787135988.319411:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 242 00000100:00100000:3.0:1787135988.319423:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+6:2358:x1873947595480704:12345-192.168.203.38@tcp:39:umount.0 00000100:00080000:2.0:1787135988.319423:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1787135988.319535:0:5822:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f20247b 00000020:00010000:3.0:1787135988.319556:0:5822:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e9876a70800: total 0 00000100:00080000:3.0:1787135988.319560:0:5822:0:(import.c:65:import_set_state_nolock()) ffff8e9876a71000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787135988.319592:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:2.0:1787135988.320356:0:5810:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e9876a70800: total 0 00010000:00010000:2.0:1787135988.320409:0:5810:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e9876a70800, canceled 0 locks, left on hash table 1. 00000100:00100000:3.0:1787135988.320418:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0410dc70-43f2-4e7e-8b1a-609a240ccdf4+5:2358:x1873947595480704:12345-192.168.203.38@tcp:39:umount.0 Request processed in 996us (1104us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787135988.320428:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 242 00010000:00010000:2.0:1787135988.320445:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98494a1a00) 00010000:00010000:2.0:1787135988.320450:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787135988.320459:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f2033af lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185b1 expref: 4 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135988.320486:0:5810:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e9876a70800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1787135988.320497:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135988.320500:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787135988.320501:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135988.337036:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787135988.337260:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595480960 00000100:00100000:0.0:1787135988.337272:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595480960 00000100:00100000:0.0:1787135988.337318:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 300 00000100:00100000:0.0:1787135988.337328:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e984573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+7:2358:x1873947595480960:12345-192.168.203.38@tcp:251:umount.0 00000020:00000080:0.0:1787135988.337373:0:5816:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202371 00000020:00010000:0.0:1787135988.337380:0:5816:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e9746924800: total 0 00000100:00080000:0.0:1787135988.337385:0:5816:0:(import.c:65:import_set_state_nolock()) ffff8e9746925000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787135988.337476:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e984573f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ccb52158-7d35-4065-a26d-1bb142899404+3:2358:x1873947595480960:12345-192.168.203.38@tcp:251:umount.0 Request processed in 149us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135988.337484:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 300 00000020:00010000:3.0:1787135988.337697:0:5809:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e9746924800: total 0 00010000:00010000:3.0:1787135988.337701:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135988.337742:0:5809:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e9746924800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787135988.337774:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e987c2c7600/0xf5850c552f2023c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71813c expref: 2 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135988.337788:0:5809:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e9746924800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1787135988.337908:0:5809:0:(genops.c:906:class_export_put()) final put ffff8e9746924800/ccb52158-7d35-4065-a26d-1bb142899404 00010000:00010000:3.0:1787135988.337925:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135988.337928:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135988.337929:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787135988.337965:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9746924800/ccb52158-7d35-4065-a26d-1bb142899404 for MGS 00000020:00000080:0.0:1787135988.338005:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9746925000 for MGS 00000001:00100000:3.0:1787135988.766337:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000001:00080000:3.0:1787135988.766353:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787135988.766373:0:5844:0:(genops.c:906:class_export_put()) final put ffff8e9746920000/a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000001:00100000:3.0:1787135988.766388:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0410dc70-43f2-4e7e-8b1a-609a240ccdf4 00000001:00080000:3.0:1787135988.766394:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1787135988.766396:0:5844:0:(genops.c:906:class_export_put()) final put ffff8e9876a70800/0410dc70-43f2-4e7e-8b1a-609a240ccdf4 00000020:00000080:0.0:1787135988.766617:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9746920000/a1006dc5-9c90-4762-af1c-1ab0be9a05b8 for lustre-MDT0000 00000020:00000080:0.0:1787135988.766678:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9876a70800/0410dc70-43f2-4e7e-8b1a-609a240ccdf4 for lustre-MDT0000 00000020:00000080:0.0:1787135988.766696:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e984758e800 for lustre-MDT0000 00000020:00000080:0.0:1787135988.766701:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9876a71000 for lustre-MDT0000 00000001:00100000:2.0:1787135988.813984:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000020:00000080:2.0:1787135988.813993:0:7625:0:(genops.c:906:class_export_put()) final put ffff8e9851517800/a1006dc5-9c90-4762-af1c-1ab0be9a05b8 00000020:00000080:1.0:1787135988.814085:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9851517800/a1006dc5-9c90-4762-af1c-1ab0be9a05b8 for lustre-OST0001 00000020:00000080:1.0:1787135988.814161:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e984564a800 for lustre-OST0001 00010000:00010000:0.0:1787135988.824263:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135989.848463:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787135990.032978:0:12945:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1787135990.053225:0:12945:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1787135990.053272:0:12945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135990.053287:0:12945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135990.053295:0:12945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787135990.053319:0:12945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.054514:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787135990.054525:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.054551:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841489400 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:0.0:1787135990.054554:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.054563:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787135990.054571:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135990.054576:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787135990.054578:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00010000:00010000:0.0:1787135990.054609:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.054615:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787135990.054645:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.054653:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135990.054654:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135990.054656:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135990.054673:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616429184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787135990.054734:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787135990.054883:0:12945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787135990.054890:0:12945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9841489400/0xf5850c552f202404 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f20240b expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787135990.054904:0:12945:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 10000000:01000000:2.0:1787135990.054909:0:12945:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1787135990.054933:0:12945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787135990.054937:0:12945:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1787135990.054941:0:12945:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787135990.054954:0:12945:0:(import.c:65:import_set_state_nolock()) ffff8e9876aad800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787135990.054974:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873947616429312:0@lo:39:umount.0 00000100:00100000:2.0:1787135990.055004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135990.056251:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616429184 00000100:00100000:0.0:1787135990.056262:0:5808:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616429184 00000100:00100000:0.0:1787135990.056315:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787135990.056324:0:5808:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+19:3302:x1873947616429184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787135990.056531:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787135990.056551:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511dae00/0xf5850c552f20240b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f202404 expref: 19 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.056565:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787135990.056622:0:5808:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e67bffa2-3749-4eab-9303-62ad12948de4+18:3302:x1873947616429184:12345-0@lo:103:ldlm_bl.0 Request processed in 300us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135990.056630:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787135990.056670:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616429184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787135990.069388:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616429312 00000100:00100000:0.0:1787135990.069403:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616429312 00000100:00100000:0.0:1787135990.069545:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1787135990.069556:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873947616429312:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787135990.069586:0:5821:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202180 00000100:00080000:0.0:1787135990.069594:0:5821:0:(import.c:65:import_set_state_nolock()) ffff8e9845649000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787135990.069687:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3299:x1873947616429312:12345-0@lo:39:umount.0 Request processed in 133us (14680us total) trans 0 rc 0/0 00000100:00100000:0.0:1787135990.069694:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000020:00000080:0.0:1787135990.069704:0:5821:0:(genops.c:906:class_export_put()) final put ffff8e984564e000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1787135990.069796:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787135990.070563:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e9876aad800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787135990.070585:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873947616429312:0@lo:39:umount.0 00000100:00080000:0.0:1787135990.070666:0:12945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787135990.070670:0:12945:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787135990.070675:0:12945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787135990.071991:0:12945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072007:0:12945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072029:0:12945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072036:0:12945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072247:0:12945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787135990.072255:0:12945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072263:0:12945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072269:0:12945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072275:0:12945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072285:0:12945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787135990.072292:0:12945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072299:0:12945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072305:0:12945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072321:0:12945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072329:0:12945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1787135990.072334:0:12945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030000/0xf5850c552f2020df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072339:0:12945:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030000/0xf5850c552f2020df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072416:0:12945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030000/0xf5850c552f2020df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072486:0:12945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e9840030000/0xf5850c552f2020df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.072498:0:12945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1787135990.072502:0:12945:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787135990.072530:0:12945:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787135990.072534:0:12945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787135990.072538:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787135990.072543:0:12945:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1787135990.072550:0:12945:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8e98746a0800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787135990.072556:0:12945:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8e9852432000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787135990.072561:0:12945:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8e9852f23380) has exports, disconnecting them 00000020:00080000:0.0:1787135990.072565:0:12945:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e98746a0800), last request at 1787135987 00000020:00000080:0.0:1787135990.072571:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f2022f3 00000100:00080000:0.0:1787135990.072588:0:12945:0:(import.c:65:import_set_state_nolock()) ffff8e98746a1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787135990.072635:0:12945:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e98746a0800): rc 0 00000020:00000080:0.0:1787135990.072638:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e98746a0800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1787135990.072644:0:12945:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e9852432000), last request at 1787135987 00000020:00000080:0.0:1787135990.072648:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202228 00000100:00080000:0.0:1787135990.072654:0:12945:0:(import.c:65:import_set_state_nolock()) ffff8e98533e1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787135990.072660:0:12945:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e9852432000): rc 0 00000020:00000080:0.0:1787135990.072663:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e9852432000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1787135990.072669:0:12945:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9f5d83cdfae0 00000100:00080000:0.0:1787135990.072686:0:12945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787135990.072689:0:12945:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1787135990.072707:0:12945:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787135990.072768:0:12945:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:3.0:1787135990.072863:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787135990.072871:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.072879:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840031a00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:3.0:1787135990.072882:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.072891:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787135990.072898:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787135990.072903:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787135990.072905:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1787135990.072907:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1787135990.072936:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.072941:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787135990.072964:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.072970:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840031a00/0xf5850c552f202412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f202419 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.072980:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787135990.072984:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.072998:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9841488e00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:3.0:1787135990.073001:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073007:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787135990.073013:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787135990.073018:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787135990.073020:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787135990.073022:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787135990.073035:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073041:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787135990.073077:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073084:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9841488e00/0xf5850c552f20232b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f202332 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073106:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787135990.073110:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073115:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6000 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:3.0:1787135990.073117:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073130:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787135990.073137:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787135990.073142:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787135990.073144:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787135990.073146:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787135990.073161:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073167:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787135990.073173:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073178:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6000/0xf5850c552f20261f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f202626 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073187:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787135990.073191:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9840030000/0xf5850c552f2020df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073196:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840030000 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:3.0:1787135990.073198:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9840030000/0xf5850c552f2020df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073205:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840030000/0xf5850c552f2020df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787135990.073220:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840030000/0xf5850c552f2020df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787135990.073224:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787135990.073226:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1787135990.073228:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1787135990.073241:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9840030000/0xf5850c552f2020df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073245:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787135990.073251:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9840030000/0xf5850c552f2020df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073256:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840030000/0xf5850c552f2020df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f2020e6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073267:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135990.073268:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135990.073270:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135990.073286:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616429440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787135990.073357:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135990.073402:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787135990.073407:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616429824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787135990.073440:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135990.073468:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616429568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787135990.073487:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135990.073503:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787135990.073507:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98744fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616429696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787135990.073566:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135990.073594:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616429440 00000100:00100000:3.0:1787135990.073601:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616429440 00000100:00100000:3.0:1787135990.073634:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616429824 00000100:00100000:3.0:1787135990.073637:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616429824 00000100:00100000:3.0:1787135990.073650:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616429568 00000100:00100000:3.0:1787135990.073652:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616429568 00000100:00100000:3.0:1787135990.073662:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616429696 00000100:00100000:3.0:1787135990.073664:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616429696 00000100:00100000:3.0:1787135990.073678:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787135990.073686:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+21:3303:x1873947616429440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787135990.073697:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135990.073711:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511dbc00/0xf5850c552f202419 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f202412 expref: 21 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.073722:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135990.073756:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+20:3303:x1873947616429440:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135990.073763:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787135990.073779:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787135990.074085:0:12945:0:(import.c:65:import_set_state_nolock()) ffff8e9881f43800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1787135990.074109:0:12945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787135990.074112:0:12945:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1787135990.074121:0:12945:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1787135990.074179:0:12945:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1787135990.074189:0:12945:0:(import.c:65:import_set_state_nolock()) ffff8e987486d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1787135990.074217:0:12945:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8e9852f23380) has no exports 00000100:00100000:3.0:1787135990.074274:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+19:3303:x1873947616429824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787135990.074284:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135990.074295:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98820e3e00/0xf5850c552f2020e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f2020df expref: 19 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.074307:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135990.074331:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+18:3303:x1873947616429824:12345-0@lo:103:ldlm_bl.0 Request processed in 547us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135990.074338:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787135990.074369:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787135990.074374:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+17:3300:x1873947616429568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787135990.074381:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135990.074389:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9840031200/0xf5850c552f202332 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f20232b expref: 17 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.074399:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135990.074489:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+16:3300:x1873947616429568:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135990.074495:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787135990.074508:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787135990.074514:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+15:3300:x1873947616429696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787135990.074522:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787135990.074532:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9874896c00/0xf5850c552f202626 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f20261f expref: 15 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787135990.074539:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787135990.074561:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e67bffa2-3749-4eab-9303-62ad12948de4+14:3300:x1873947616429696:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135990.074566:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1787135990.074653:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787135990.074663:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616429952:0@lo:9:umount.0 00000100:00100000:3.0:1787135990.074694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135990.074718:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616430080:0@lo:9:umount.0 00000100:00100000:3.0:1787135990.074737:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787135990.074765:0:12502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616429952 00000100:00100000:3.0:1787135990.074770:0:12502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616429952 00000100:00100000:3.0:1787135990.074929:0:12502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616430080 00000100:00100000:3.0:1787135990.074933:0:12502:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616430080 00000100:00100000:3.0:1787135990.074952:0:12502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787135990.074959:0:12502:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3299:x1873947616429952:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787135990.074981:0:12502:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202275 00000100:00080000:3.0:1787135990.074987:0:12502:0:(import.c:65:import_set_state_nolock()) ffff8e9744a93800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787135990.075019:0:12502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1787135990.075667:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616429696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787135990.075680:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e67bffa2-3749-4eab-9303-62ad12948de4:3300:1873947616429568:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1787135990.075892:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e984564e000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787135990.075939:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e98746a0800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787135990.075962:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9852432000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787135990.075983:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9845649000 for lustre-MDT0000 00000020:00000080:2.0:1787135990.075988:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e98746a1000 for lustre-MDT0000 00000020:00000080:2.0:1787135990.075991:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e98533e1000 for lustre-MDT0000 00000100:00100000:2.0:1787135990.076015:0:11994:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787135990.076026:0:11994:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3299:x1873947616430080:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787135990.076043:0:11994:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f20235c 00000100:00080000:2.0:1787135990.076066:0:11994:0:(import.c:65:import_set_state_nolock()) ffff8e9874868800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787135990.076101:0:11994:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:0.0:1787135990.079128:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787135990.079137:0:5817:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787135990.079178:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616429824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787135990.079192:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98744fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616429440:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787135990.079233:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e9881f43800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787135990.079270:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787135990.079273:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787135990.079277:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616429952:0@lo:9:umount.0 00010000:00010000:0.0:1787135990.079299:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787135990.081001:0:11994:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3299:x1873947616430080:12345-0@lo:9:umount.0 Request processed in 4970us (6254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787135990.081014:0:11994:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1787135990.081592:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e987486d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787135990.081611:0:3299:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787135990.081613:0:3299:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787135990.081617:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616430080:0@lo:9:umount.0 00000100:00100000:3.0:1787135990.081941:0:12502:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3299:x1873947616429952:12345-0@lo:9:umount.0 Request processed in 6980us (7243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787135990.081950:0:12502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1787135990.081975:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787135990.090563:0:12945:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8e9852f23380) has no exports 00000020:00000080:2.0:1787135990.144654:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f20213a 00000020:00000080:2.0:1787135990.144671:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e987c6e1000/lustre-QMT0000_UUID 00000020:01000000:2.0:1787135990.144728:0:12945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787135990.144819:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787135990.144829:0:12945:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787135990.144835:0:12945:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8e9851eecd40) has no exports 00000020:00000080:3.0:1787135990.145145:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202133 00000020:00000080:3.0:1787135990.145151:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e9876aaa000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787135990.145317:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e987c6e1000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787135990.145503:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9876aaa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787135990.145568:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787135990.145576:0:12945:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1787135990.145579:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e987bd23800/lustre-QMT0000_UUID 00000020:00000080:3.0:1787135990.145581:0:12945:0:(genops.c:865:class_export_destroy()) destroying export ffff8e987bd23800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1787135990.145588:0:12945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1787135990.145697:0:12945:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e9876bc87e0 - data ffff8e986e72b6c0/ffff8e9745ea3c00 00000020:01000000:3.0:1787135990.145918:0:12945:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e9842fe6ba0 - data ffff8e986e5de870/ffff8e987c70b000 00000001:00000004:3.0:1787135990.167230:0:12945:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787135990.222800:0:12945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787135990.222808:0:12945:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787135990.222835:0:12945:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787135990.222838:0:12945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787135990.223364:0:6718:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787135990.223370:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1787135990.223380:0:6718:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1787135990.224300:0:12945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787135990.224305:0:12945:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1787135990.224325:0:12945:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787135990.224327:0:12945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787135990.224615:0:8041:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787135990.224619:0:8041:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787135990.224628:0:8041:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1787135990.273195:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202102 00000020:00000080:0.0:1787135990.273206:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e984564b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787135990.273996:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202117 00000020:00000080:0.0:1787135990.274005:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e98533e7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787135990.274011:0:12945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787135990.274016:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787135990.274025:0:12945:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787135990.274029:0:12945:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8e9852f20000) has no exports 00000004:01000000:0.0:1787135990.274270:0:12945:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787135990.274279:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202355 00000020:00000080:0.0:1787135990.274283:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e987486e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787135990.274287:0:12945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787135990.274291:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787135990.274298:0:12945:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787135990.274300:0:12945:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8e98434699c0) has no exports 00000020:00000080:0.0:1787135990.274306:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f20234e 00000020:00000080:0.0:1787135990.274310:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e9874868000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787135990.274626:0:12945:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787135990.274639:0:12945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787135990.274643:0:12945:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787135990.274648:0:12945:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787135990.274651:0:12945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787135990.274679:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787135990.274686:0:12945:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787135990.274691:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f20226e 00000020:00000080:0.0:1787135990.274695:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e9744a97800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787135990.274701:0:12945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787135990.274704:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787135990.274707:0:12945:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787135990.274710:0:12945:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8e9851eeb380) has no exports 00000020:00000080:0.0:1787135990.274713:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202267 00000020:00000080:0.0:1787135990.274716:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e9881f40800/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1787135990.275012:0:12945:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787135990.275016:0:12945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787135990.275018:0:12945:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787135990.275022:0:12945:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787135990.275023:0:12945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787135990.275073:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787135990.275078:0:12945:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787135990.275113:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787135990.275117:0:12945:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787135990.275141:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f20211e 00000020:00000080:0.0:1787135990.275145:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e98533e2800/lustre-MDD0000_UUID 00000020:01000000:0.0:1787135990.275148:0:12945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787135990.275152:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787135990.275155:0:12945:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787135990.275158:0:12945:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8e9852f219c0) has no exports 00000020:00000080:0.0:1787135990.275178:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787135990.275181:0:12945:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787135990.275185:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202125 00000020:00000080:0.0:1787135990.275195:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e98533e3000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787135990.275202:0:12945:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e98456a5800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787135990.275205:0:12945:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e98456a5800 3 00000020:01000004:0.0:1787135990.275207:0:12945:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e98456a5800 from lustre-MDT0000 00000020:00000080:0.0:1787135990.275227:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787135990.275230:0:12945:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787135990.275233:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e9845648800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787135990.275235:0:12945:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9845648800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787135990.275244:0:12945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787135990.275301:0:12945:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787135990.275305:0:12945:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787135990.275307:0:12945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787135990.275310:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787135990.275313:0:12945:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787135990.275320:0:12945:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8e9851ef9800 e67bffa2-3749-4eab-9303-62ad12948de4 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787135990.275325:0:12945:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8e9860764d40) has exports, disconnecting them 00000020:00080000:0.0:1787135990.275329:0:12945:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e9851ef9800), last request at 1787135778 00000020:00000080:0.0:1787135990.275341:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f2020c3 00000020:00010000:0.0:1787135990.275345:0:12945:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e9851ef9800: total 8 00000100:00080000:0.0:1787135990.275349:0:12945:0:(import.c:65:import_set_state_nolock()) ffff8e9851efb000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787135990.275367:0:12945:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e9851ef9800): rc 0 00000020:00080000:0.0:1787135990.275371:0:12945:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8e9860764d40) has no exports 00000020:00010000:0.0:1787135990.275384:0:5810:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e9851ef9800: total 8 00010000:00010000:0.0:1787135990.275404:0:5810:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e9851ef9800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787135990.275430:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511db000/0xf5850c552f2023e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f2023da expref: 9 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.275446:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511daa00/0xf5850c552f2023ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f2023e8 expref: 8 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.275457:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511da400/0xf5850c552f20260a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f202603 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.275474:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98533ae400/0xf5850c552f202618 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f202611 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.275488:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9840030400/0xf5850c552f2023fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f2023f6 expref: 5 pid: 5815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.275499:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98413ca200/0xf5850c552f2021db lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f2021d4 expref: 4 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.275511:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511db200/0xf5850c552f202427 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f202420 expref: 3 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.275521:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9840031e00/0xf5850c552f2023d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf5850c552f2023cc expref: 2 pid: 5816 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135990.275533:0:5810:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e9851ef9800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787135990.275544:0:5810:0:(genops.c:906:class_export_put()) final put ffff8e9851ef9800/e67bffa2-3749-4eab-9303-62ad12948de4 00010000:00010000:0.0:1787135990.275549:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135990.275551:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135990.275553:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135990.275603:0:5816:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e9850012e00:5816] 2 exiting: rc = 0 00000100:00100000:1.0:1787135990.275762:0:5813:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e9851c3d800:5813] 0 exiting: rc = 1 00000100:00100000:1.0:1787135990.275808:0:5815:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e9860661e00:5815] 1 exiting: rc = 0 00000020:00000080:2.0:1787135990.275891:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e984564b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787135990.275903:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e98533e7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1787135990.275908:0:8:0:(genops.c:906:class_export_put()) final put ffff8e984564f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787135990.275911:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e984564f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787135990.275914:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787135990.276023:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e987486e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787135990.276028:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9874868000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787135990.276033:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e987486d800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1787135990.276036:0:8:0:(genops.c:906:class_export_put()) final put ffff8e987486d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787135990.276038:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e987486d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1787135990.276041:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787135990.276094:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9744a97800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787135990.276102:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9881f40800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787135990.276106:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9881f43800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1787135990.276116:0:8:0:(genops.c:906:class_export_put()) final put ffff8e9842bc5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787135990.276119:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9842bc5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1787135990.276122:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787135990.276177:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e98533e2800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1787135990.276181:0:8:0:(genops.c:906:class_export_put()) final put ffff8e984564c000/lustre-MDD0000_UUID 00000020:00000080:2.0:1787135990.276183:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e984564c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1787135990.276185:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1787135990.276311:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e98533e3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787135990.276315:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9851ef9800/e67bffa2-3749-4eab-9303-62ad12948de4 for MGS 00000020:00000080:2.0:1787135990.276342:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9851efb000 for MGS 00000100:00100000:0.0:1787135990.276630:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276639:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276645:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276650:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276656:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276662:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276668:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276696:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276703:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276723:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276729:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276734:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276740:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276745:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276751:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276758:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276764:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276769:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276774:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276972:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276981:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276987:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276992:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.276997:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277002:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277008:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277013:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277018:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277023:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277027:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277032:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277037:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277041:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277409:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277418:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277423:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277428:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277434:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277438:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277444:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277449:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277453:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277458:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277463:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277478:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277483:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277488:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277493:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277499:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277504:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277509:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277514:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277520:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277528:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277533:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277537:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277543:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277548:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277553:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277558:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277563:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277567:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277571:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787135990.277576:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787135990.277914:0:12945:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787135990.277917:0:12945:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787135990.278924:0:12945:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e9876bc8540 - data ffff8e986e593870/ffff8e974691f400 00000020:01000000:0.0:1787135990.279040:0:12945:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e9866010f00 - data ffff8e986e764bd0/ffff8e9846149800 00000020:00000080:0.0:1787135990.279517:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f2020a7 00000020:00000080:0.0:1787135990.279524:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e98480d7800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787135990.279538:0:12945:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e98456a5800 from MGS, refs=2 00000020:01000004:0.0:1787135990.279542:0:12945:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e98456a5800 2 00000020:01000004:0.0:1787135990.279545:0:12945:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e98456a5800 from MGS 00000020:00000080:0.0:1787135990.279569:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787135990.279575:0:12945:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787135990.279578:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e98480d2000/MGS 00000020:00000080:0.0:1787135990.279580:0:12945:0:(genops.c:865:class_export_destroy()) destroying export ffff8e98480d2000/MGS for MGS 00000020:01000000:0.0:1787135990.279587:0:12945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787135990.279638:0:12945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787135990.279648:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787135990.279654:0:12945:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787135990.279660:0:12945:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e9842bc2000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787135990.279665:0:12945:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8e9851ee8000) has exports, disconnecting them 00000020:00080000:0.0:1787135990.279669:0:12945:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e9842bc2000), last request at 1787135779 00000020:00000080:0.0:1787135990.279672:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202172 00000020:00080000:0.0:1787135990.279681:0:12945:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e9842bc2000): rc 0 00000020:00000080:0.0:1787135990.279685:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e9842bc2000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787135990.280333:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e98480d7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787135990.280343:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9842bc2000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787135990.281322:0:12945:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787135990.281328:0:12945:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787135990.281333:0:12945:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787135990.281338:0:12945:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787135990.281477:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787135990.281485:0:12945:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787135990.281490:0:12945:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e98456a5800 1 00000020:00000080:1.0:1787135990.281506:0:12945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202099 00000020:00000080:1.0:1787135990.281512:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e98480d0800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1787135990.281517:0:12945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787135990.281528:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787135990.281532:0:12945:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787135990.281536:0:12945:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8e9852f24d40) has no exports 00000020:00000080:2.0:1787135990.281797:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9876aad800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1787135990.281804:0:38:0:(genops.c:906:class_export_put()) final put ffff8e9876aaf800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1787135990.281807:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9876aaf800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1787135990.281813:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1787135990.281861:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e98480d0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787135990.294399:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787135990.294413:0:12945:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1787135990.294418:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e984747e000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787135990.294423:0:12945:0:(genops.c:865:class_export_destroy()) destroying export ffff8e984747e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1787135990.294432:0:12945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1787135990.294567:0:12945:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e98456a2000 00000020:01000000:2.0:1787135990.294588:0:12945:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1787135990.294592:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787135990.294597:0:12945:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787135990.294600:0:12945:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8e9851ee99c0) has no exports 00000100:00100000:2.0:1787135990.294676:0:7623:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8e9874827a00:7623] 3 exiting: rc = 0 00000100:00100000:3.0:1787135990.294860:0:5822:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8e98606a1200:5822] 1 exiting: rc = 0 00000100:00100000:3.0:1787135990.294915:0:5823:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8e98471cba00:5823] 2 exiting: rc = 0 00000100:00100000:0.0:1787135990.296335:0:5821:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8e98606a0a00:5821] 0 exiting: rc = 1 00000100:00100000:2.0:1787135990.298686:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298695:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298701:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298719:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298724:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298730:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298735:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298740:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298745:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298750:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298756:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298768:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298776:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298781:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298788:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298805:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298811:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298815:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298821:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298827:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298831:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298836:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298843:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298848:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298854:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298860:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298865:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298871:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298877:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298883:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298889:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298894:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298899:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298905:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298910:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298915:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298921:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298926:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298939:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298945:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298950:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298955:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298960:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298966:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298971:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298977:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298983:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298988:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298993:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.298999:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299004:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299009:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299014:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299020:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299025:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299030:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299034:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299041:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299062:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299069:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299074:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299079:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299084:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.299106:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.302545:0:5824:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e98471cb600:5824] 0 exiting: rc = 1 00000100:00100000:1.0:1787135990.303446:0:5825:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e98471cae00:5825] 1 exiting: rc = 0 00000100:00100000:2.0:1787135990.303584:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303591:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303597:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303603:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303608:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303613:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303618:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303623:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303640:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303645:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303650:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303655:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303661:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303666:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303671:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303676:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303687:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303692:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303698:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303704:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303709:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303715:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303721:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303726:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303731:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303735:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303740:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303744:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303748:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303753:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303758:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303762:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303767:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303772:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303777:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303896:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303905:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303909:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303915:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303920:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303925:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303931:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303937:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303949:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303956:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303962:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303970:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303976:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303980:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303986:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303991:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.303996:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.304001:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.304006:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.304011:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.304016:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.304021:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.304027:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.304032:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.304037:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.304042:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.304074:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.304081:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.304085:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.304566:0:5826:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8e9860169800:5826] 0 exiting: rc = 1 00000100:00100000:3.0:1787135990.305378:0:5827:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8e9860168000:5827] 1 exiting: rc = 0 00000100:00100000:2.0:1787135990.306602:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306611:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306618:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306624:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306630:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306637:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306643:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306650:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306657:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306664:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306670:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306698:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306707:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306713:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306729:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306734:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306740:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306746:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306751:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306757:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306763:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306769:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306775:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306910:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306918:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306924:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306930:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306936:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306941:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306947:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306954:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306959:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306964:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306969:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306979:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.306999:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307006:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307012:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307017:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307023:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307029:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307035:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307041:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307074:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307082:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307097:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307103:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307122:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307130:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307141:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307147:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307153:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307158:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307162:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307177:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307185:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307192:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307198:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307204:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307223:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307231:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307236:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307243:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.307257:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.326723:0:5829:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e98435e5400:5829] 1 exiting: rc = 0 00000100:00100000:2.0:1787135990.328167:0:5828:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e98435e5c00:5828] 0 exiting: rc = 1 00000100:00100000:1.0:1787135990.329036:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329044:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329077:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329081:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329095:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329100:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329105:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329110:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329116:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329121:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329126:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329131:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329135:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329140:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329144:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329149:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329153:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329158:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329163:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329167:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329172:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329177:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329183:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329187:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329192:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329198:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329203:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329207:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329212:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329232:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329237:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329241:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329246:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329251:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329256:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329261:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329266:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329271:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329276:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329282:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329287:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329292:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329298:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329302:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329307:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329312:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329317:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329321:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329326:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329331:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329337:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329341:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329346:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329351:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329356:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329362:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329366:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329372:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329376:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329382:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329387:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329393:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329398:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329403:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.329742:0:5830:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e98435e5a00:5830] 0 exiting: rc = 1 00000100:00100000:2.0:1787135990.329979:0:5831:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e98435e4600:5831] 1 exiting: rc = 0 00000100:00100000:1.0:1787135990.330081:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330096:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330103:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330108:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330113:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330117:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330123:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330128:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330133:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330138:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330143:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330147:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330152:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330156:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330161:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330166:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330172:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330176:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330181:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330187:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330192:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330196:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330201:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330206:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330211:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330216:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330221:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330226:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330230:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330235:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330239:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330244:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330249:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330254:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330267:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330272:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330277:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330282:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330287:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330292:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330297:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330301:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330306:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330311:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330315:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330320:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330325:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330330:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330335:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330340:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330346:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330351:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330355:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330360:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330366:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330371:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330376:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330381:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330387:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330391:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330396:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330400:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330405:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.330409:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787135990.330729:0:5833:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e98435e4800:5833] 1 exiting: rc = 0 00000100:00100000:3.0:1787135990.330988:0:5832:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e98435e4e00:5832] 0 exiting: rc = 1 00000100:00100000:1.0:1787135990.331335:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331342:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331347:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331352:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331357:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331368:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331373:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331378:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331383:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331388:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331393:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331397:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331403:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331407:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331412:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331416:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331421:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331425:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331430:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331435:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331440:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331445:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331450:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331455:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331460:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331465:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331471:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331476:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331482:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331487:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331493:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331498:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331503:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331508:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331513:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331518:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331523:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331527:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331532:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331537:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331548:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331553:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331558:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331563:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331568:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331573:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331577:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331582:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331586:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331591:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331595:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331600:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331604:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331609:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331613:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331618:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331623:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331627:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331632:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331636:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331641:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331645:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331650:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.331654:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332210:0:5835:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8e98457d9a00:5835] 1 exiting: rc = 0 00000100:00100000:1.0:1787135990.332359:0:5836:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8e98457d8600:5836] 2 exiting: rc = 0 00000100:00100000:2.0:1787135990.332542:0:5834:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8e98457d8c00:5834] 0 exiting: rc = 1 00000100:00100000:1.0:1787135990.332674:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332680:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332685:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332690:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332695:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332700:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332714:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332720:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332725:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332739:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332745:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332752:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332758:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332763:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332769:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332775:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.332780:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.333941:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.333950:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.333955:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.333961:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.333967:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.333973:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.333996:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334003:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334009:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334014:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334019:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334024:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334028:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334033:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334039:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334059:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334066:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334072:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334077:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334081:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334096:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334102:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334108:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334113:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334120:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334125:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334130:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334148:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334154:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334159:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334177:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334183:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334188:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334193:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334198:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334204:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334210:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334216:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334221:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334226:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334231:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334236:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334241:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334247:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334252:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334258:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787135990.334263:0:12945:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787135990.343317:0:12945:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787135990.343329:0:12945:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787135990.343334:0:12945:0:(genops.c:906:class_export_put()) final put ffff8e984758b000/MDS_uuid 00000020:00000080:1.0:1787135990.343338:0:12945:0:(genops.c:865:class_export_destroy()) destroying export ffff8e984758b000/MDS_uuid for MDS 00000020:01000000:1.0:1787135990.343344:0:12945:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787135990.343467:0:12945:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787135990.873222:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787135991.832225:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787135991.832233:0:6697:0:(genops.c:906:class_export_put()) final put ffff8e9744a90800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787135991.833857:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9744a90800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787135991.833921:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9744a93800 for lustre-OST0000 00010000:00010000:0.0:1787135991.898333:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135992.794608:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616430336:0@lo:400:kworker.0 00000400:00000100:0.0:1787135992.794658:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873947616430336 offset 0 length 224: 4 00000100:00100000:0.0:1787135992.794710:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787135992.794717:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616430464:0@lo:400:kworker.0 00000400:00000100:0.0:1787135992.794733:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873947616430464 offset 0 length 224: 4 00000100:00100000:2.0:1787135992.794814:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616430208:0@lo:400:kworker.0 00000400:00000100:2.0:1787135992.794838:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873947616430208 offset 0 length 224: 4 00010000:00010000:3.0:1787135992.920212:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787135993.163598:0:13096:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787135993.184881:0:13096:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787135993.184922:0:13096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135993.184937:0:13096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135993.184945:0:13096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135993.184965:0:13096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135993.184981:0:13096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787135993.184986:0:13096:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1787135993.185006:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787135993.185012:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135993.185019:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840030c00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:0.0:1787135993.185023:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135993.185031:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787135993.185038:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787135993.185043:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787135993.185081:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1787135993.185084:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1787135993.185115:0:5810:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135993.185121:0:5810:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787135993.185145:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135993.185152:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840030c00/0xf5850c552f2023e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf5850c552f2023ef expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787135993.185168:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135993.185169:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135993.185171:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787135993.185187:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616430592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787135993.186696:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787135993.187666:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616430592 00000100:00100000:0.0:1787135993.187676:0:5807:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616430592 00000100:00100000:0.0:1787135993.187717:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787135993.187725:0:5807:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1873947616430592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787135993.187732:0:5807:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787135993 with bad export cookie 17691560271197249731 00000100:00080000:1.0:1787135993.191125:0:13096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787135993.191141:0:13096:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e98746bb800 x1873947616430336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136008 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787135993.191202:0:13096:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787135993.191209:0:13096:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787135993.191243:0:13096:0:(import.c:65:import_set_state_nolock()) ffff8e974512c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787135993.191307:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1873947616430720:0@lo:39:umount.0 00000400:00000100:1.0:1787135993.191371:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873947616430720 offset 0 length 224: 4 00000100:00100000:3.0:1787135993.201530:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616430336:0@lo:400:kworker.0 00000100:00100000:1.0:1787135993.203983:0:5807:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3302:x1873947616430592:12345-0@lo:103:ldlm_bl.0 Request processed in 16252us (17285us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787135993.203997:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787135993.206557:0:3302:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.138@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787135993.206564:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8e984747f800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787135993.206568:0:3302:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.138@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1787135993.214336:0:3302:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.138@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787135993.214342:0:3302:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787135993.214351:0:3302:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e98746b9c00 x1873947616430208/t0(0) o400->MGC192.168.203.138@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787136008 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787135993.214423:0:3302:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e98746b8e00 x1873947616430592/t0(0) o103->MGC192.168.203.138@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787136009 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787135993.214433:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787135993.214436:0:3302:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787135993.214437:0:3302:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787135993.214440:0:3302:0:(import.c:65:import_set_state_nolock()) ffff8e984747f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787135993.214445:0:3302:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 137 00000100:00080000:0.0:1787135993.214454:0:3302:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff8e984747f800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1787135993.214559:0:3302:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9881fa5500 x1873947616430848/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787135993.214600:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e67bffa2-3749-4eab-9303-62ad12948de4:3302:1873947616430592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787135993.214661:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e67bffa2-3749-4eab-9303-62ad12948de4:3299:1873947616430848:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1787135993.214720:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873947616430848 offset 0 length 520: 4 00000100:00100000:2.0:1787135993.214968:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e67bffa2-3749-4eab-9303-62ad12948de4:3303:1873947616430208:0@lo:400:kworker.0 00000001:00100000:3.0:1787135993.871844:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787135993.871853:0:7625:0:(genops.c:906:class_export_put()) final put ffff8e987486b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787135993.871914:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e987486b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1787135993.871964:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9874868800 for lustre-OST0001 00010000:00010000:3.0:1787135993.945539:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787135994.968344:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787135995.992334:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787135997.016297:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787135997.913017:0:12897:0:(pinger.c:229:ptlrpc_pinger_process_import()) e67bffa2-3749-4eab-9303-62ad12948de4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787135997.913026:0:12897:0:(pinger.c:247:ptlrpc_pinger_process_import()) e67bffa2-3749-4eab-9303-62ad12948de4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787135997.913220:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787135997.913238:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616430976:0@lo:400:kworker.0 00000400:00000100:1.0:1787135997.913287:0:3302:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873947616430976 offset 0 length 224: 4 00010000:00010000:3.0:1787135998.040280:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787135998.937178:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e67bffa2-3749-4eab-9303-62ad12948de4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787135998.937189:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) e67bffa2-3749-4eab-9303-62ad12948de4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787135998.937289:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787135998.937307:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616431104:0@lo:400:kworker.0 00000400:00000100:2.0:1787135998.937368:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873947616431104 offset 0 length 224: 4 00010000:00010000:1.0:1787135999.064872:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136000.088336:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136001.112357:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136002.136174:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136003.160399:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787136003.548194:0:3299:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787135993/real 1787135993] req@ffff8e9881fa5500 x1873947616430848/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787136003 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787136003.548226:0:3299:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e9881fa5500 x1873947616430848/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787136003 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787136003.548237:0:3299:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787135993/real 1787135993] req@ffff8e9881fa6680 x1873947616430720/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787136003 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787136003.548251:0:3299:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e9881fa6680 x1873947616430720/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787136003 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787136003.548270:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e984747f800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787136003.548291:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1787136003.548295:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e67bffa2-3749-4eab-9303-62ad12948de4:3299:1873947616430848:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:0.0:1787136003.548302:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e974512c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787136003.548318:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1873947616430720:0@lo:39:umount.0 00000100:00080000:2.0:1787136003.548551:0:13096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787136003.548568:0:13096:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787136003.548572:0:13096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1787136003.548593:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e67bffa2-3749-4eab-9303-62ad12948de4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787136003.548598:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1787136003.548601:0:38:0:(import.c:65:import_set_state_nolock()) ffff8e984747f800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787136003.548606:0:38:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 353 00000100:00080000:1.0:1787136003.548611:0:38:0:(import.c:589:import_select_connection()) MGC192.168.203.138@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787136003.548616:0:38:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff8e984747f800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1787136003.548643:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9881fa6680 x1873947616431232/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787136003.548698:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787136003.548709:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616431360:0@lo:400:kworker.0 00000400:00000100:1.0:1787136003.548774:0:3300:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873947616431360 offset 0 length 224: 4 00000100:00100000:0.0:1787136003.548890:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e67bffa2-3749-4eab-9303-62ad12948de4:3299:1873947616431232:0@lo:250:kworker.0 00000400:00000100:0.0:1787136003.548913:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1873947616431232 offset 0 length 520: 4 00010000:00010000:2.0:1787136003.549866:0:13096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136003.549882:0:13096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136003.549890:0:13096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136003.549896:0:13096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136003.549921:0:13096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136003.549930:0:13096:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136003.549936:0:13096:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136003.549942:0:13096:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136003.549948:0:13096:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136003.549957:0:13096:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787136003.549961:0:13096:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1787136003.549981:0:13096:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1787136003.549984:0:13096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1787136003.550006:0:13096:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787136003.550013:0:13096:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787136003.550017:0:13096:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8e9744a999c0) has no exports 00000020:00080000:2.0:1787136003.550041:0:13096:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8e9744a999c0) has no exports 00010000:00010000:0.0:1787136003.550569:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787136003.550577:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136003.550586:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511da600 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:0.0:1787136003.550590:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136003.550607:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787136003.550615:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787136003.550620:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787136003.550623:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1787136003.550626:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1787136003.550639:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e984747f800 00010000:00010000:0.0:1787136003.550643:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136003.550650:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98511da600/0xf5850c552f2023f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf5850c552f2023fd expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136003.550663:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787136003.550666:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136003.550671:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896800 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:0.0:1787136003.550674:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136003.550680:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787136003.550686:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787136003.550702:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787136003.550704:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787136003.550706:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787136003.550714:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e984747f800 00010000:00010000:0.0:1787136003.550717:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136003.550723:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9874896800/0xf5850c552f202611 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf5850c552f202618 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136003.550744:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136003.550746:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136003.550748:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136003.550894:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787136003.558814:0:13096:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e9876bc8240 - data ffff8e98722e8000/ffff8e9744a53800 00000020:01000000:2.0:1787136003.558934:0:13096:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e9842fe6060 - data ffff8e986e7b7af8/ffff8e9744a56800 00100000:10000000:3.0:1787136003.588375:0:13096:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1787136003.616361:0:13096:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f2021f7 00000020:00000080:3.0:1787136003.616370:0:13096:0:(genops.c:906:class_export_put()) final put ffff8e9881f42800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1787136003.616392:0:13096:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e98735aa000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1787136003.616395:0:13096:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e98735aa000 2 00000020:01000004:3.0:1787136003.616398:0:13096:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e98735aa000 from lustre-OST0000 00000020:00000080:3.0:1787136003.616423:0:13096:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787136003.616432:0:12897:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9881f42800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787136003.616433:0:13096:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1787136003.616439:0:13096:0:(genops.c:906:class_export_put()) final put ffff8e9881f45000/lustre-OST0000_UUID 00000020:00000080:3.0:1787136003.616442:0:13096:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9881f45000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1787136003.616451:0:13096:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1787136003.616490:0:13096:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1787136003.616494:0:13096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1787136003.616499:0:13096:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787136003.616504:0:13096:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787136003.616510:0:13096:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e9842bc2800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787136003.616516:0:13096:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8e9744a9cd40) has exports, disconnecting them 00000020:00080000:3.0:1787136003.616521:0:13096:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e9842bc2800), last request at 1787135797 00000020:00000080:3.0:1787136003.616535:0:13096:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202221 00000020:00080000:3.0:1787136003.616545:0:13096:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e9842bc2800): rc 0 00000020:00000080:3.0:1787136003.616551:0:13096:0:(genops.c:906:class_export_put()) final put ffff8e9842bc2800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1787136003.616585:0:12897:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9842bc2800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1787136003.628120:0:13096:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1787136003.628130:0:13096:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787136003.628134:0:13096:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1787136003.628140:0:13096:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787136003.628351:0:13096:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787136003.628360:0:13096:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1787136003.628368:0:13096:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e98735aa000 1 00000020:00000080:2.0:1787136003.628374:0:13096:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f2021b1 00000020:00000080:2.0:1787136003.628381:0:13096:0:(genops.c:906:class_export_put()) final put ffff8e987c6e5000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787136003.628402:0:12897:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e974512c800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787136003.628409:0:12897:0:(genops.c:906:class_export_put()) final put ffff8e9881f43000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1787136003.628411:0:12897:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9881f43000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1787136003.628422:0:12897:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1787136003.633427:0:13096:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1787136003.633468:0:13096:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787136003.633476:0:13096:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787136003.633481:0:13096:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8e9860763380) has no exports 00000020:00000080:0.0:1787136003.633752:0:12897:0:(genops.c:865:class_export_destroy()) destroying export ffff8e987c6e5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1787136003.680969:0:13096:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787136003.680982:0:13096:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1787136003.680987:0:13096:0:(genops.c:906:class_export_put()) final put ffff8e98735af800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1787136003.680992:0:13096:0:(genops.c:865:class_export_destroy()) destroying export ffff8e98735af800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1787136003.681013:0:13096:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1787136003.681184:0:13096:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e98735ae800 00000020:02000400:2.0:1787136003.682978:0:13096:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787136004.184296:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136005.213428:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136006.233220:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787136006.337722:0:13249:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787136006.357230:0:13249:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787136006.357309:0:13249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136006.357325:0:13249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136006.357333:0:13249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136006.357341:0:13249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136006.357359:0:13249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787136006.357364:0:13249:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787136006.357384:0:13249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787136006.357395:0:13249:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e98746b8a80 x1873947616430464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136008 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787136006.357421:0:13249:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e9876bd1880 x1873947616430976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136013 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1787136006.357524:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787136006.357531:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136006.357539:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7e00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:1.0:1787136006.357542:0:5810:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136006.357551:0:5810:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787136006.357558:0:5810:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787136006.357565:0:5810:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787136006.357568:0:5810:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787136006.357571:0:5810:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787136006.357583:0:5810:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e984747f800 00010000:00010000:1.0:1787136006.357587:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136006.357594:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e987c2c7e00/0xf5850c552f2023cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf5850c552f2023d3 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136006.357605:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136006.357620:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136006.357622:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787136006.357700:0:13249:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e974499df80 x1873947616431104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136014 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787136006.357721:0:13249:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e9881fa5500 x1873947616431360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136019 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787136006.357731:0:13249:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787136006.357736:0:13249:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787136006.357763:0:13249:0:(import.c:65:import_set_state_nolock()) ffff8e9746924000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787136006.357860:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616431360:0@lo:400:kworker.0 00000100:00100000:2.0:1787136006.357870:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616430464:0@lo:400:kworker.0 00000100:00100000:1.0:1787136006.358012:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616431104:0@lo:400:kworker.0 00000100:00100000:0.0:1787136006.358195:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616430976:0@lo:400:kworker.0 00000100:00100000:0.0:1787136006.358224:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1873947616431488:0@lo:39:umount.0 00000400:00000100:0.0:1787136006.358269:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1873947616431488 offset 0 length 224: 4 00010000:00010000:1.0:1787136007.256510:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136008.281242:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787136008.665451:0:12897:0:(pinger.c:229:ptlrpc_pinger_process_import()) e67bffa2-3749-4eab-9303-62ad12948de4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787136008.665462:0:12897:0:(pinger.c:247:ptlrpc_pinger_process_import()) e67bffa2-3749-4eab-9303-62ad12948de4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1787136009.309391:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136010.329346:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136011.354443:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136012.376965:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136013.400806:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787136013.784164:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) e67bffa2-3749-4eab-9303-62ad12948de4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787136013.784174:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) e67bffa2-3749-4eab-9303-62ad12948de4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787136014.424256:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136015.448534:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136016.474572:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787136016.600200:0:3299:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787136006/real 1787136006] req@ffff8e974499ce00 x1873947616431488/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787136016 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787136016.600231:0:3299:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e974499ce00 x1873947616431488/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787136016 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787136016.600267:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e9746924000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787136016.600290:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1873947616431488:0@lo:39:umount.0 00000100:00080000:1.0:1787136016.600356:0:13249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787136016.600363:0:13249:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787136016.600367:0:13249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787136016.601289:0:13249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136016.601304:0:13249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136016.601311:0:13249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136016.601316:0:13249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136016.601341:0:13249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787136016.601347:0:13249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136016.601353:0:13249:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136016.601370:0:13249:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136016.601377:0:13249:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136016.601399:0:13249:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787136016.601403:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:01000000:1.0:1787136016.601405:0:13249:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:0.0:1787136016.601413:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136016.601423:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9840031400 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:0.0:1787136016.601427:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787136016.601433:0:13249:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00010000:00010000:0.0:1787136016.601436:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:1.0:1787136016.601439:0:13249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1787136016.601446:0:13249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 10000000:00010000:0.0:1787136016.601449:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1787136016.601453:0:13249:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 10000000:01000000:0.0:1787136016.601459:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00080000:1.0:1787136016.601461:0:13249:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8e9874180000) has no exports 10000000:01000000:0.0:1787136016.601464:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787136016.601468:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787136016.601482:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e984747f800 00010000:00010000:0.0:1787136016.601486:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1787136016.601487:0:13249:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8e9874180000) has no exports 00010000:00010000:0.0:1787136016.601497:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840031400/0xf5850c552f2023da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf5850c552f2023e1 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136016.601511:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787136016.601514:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136016.601528:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6a00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:0.0:1787136016.601531:0:5809:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136016.601538:0:5809:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787136016.601544:0:5809:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787136016.601549:0:5809:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787136016.601551:0:5809:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787136016.601553:0:5809:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787136016.601560:0:5809:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e984747f800 00010000:00010000:0.0:1787136016.601562:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136016.601569:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e987c2c6a00/0xf5850c552f202603 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf5850c552f20260a expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136016.601581:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136016.601582:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136016.601584:0:5809:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136016.601706:0:5810:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1787136016.603150:0:13249:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e9876bc89c0 - data ffff8e985d4580d8/ffff8e9876b5d400 00000020:01000000:1.0:1787136016.603261:0:13249:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e98606441e0 - data ffff8e986e757948/ffff8e9873c60000 00100000:10000000:1.0:1787136016.612397:0:13249:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787136016.678957:0:13249:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f2022c2 00000020:00000080:2.0:1787136016.678967:0:13249:0:(genops.c:906:class_export_put()) final put ffff8e98746a7000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787136016.678990:0:13249:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e9744a91800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787136016.678994:0:13249:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e9744a91800 2 00000020:01000004:2.0:1787136016.678997:0:13249:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e9744a91800 from lustre-OST0001 00000020:00000080:2.0:1787136016.679036:0:13249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787136016.679071:0:13249:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787136016.679075:0:13249:0:(genops.c:906:class_export_put()) final put ffff8e98746a2000/lustre-OST0001_UUID 00000020:00000080:2.0:1787136016.679078:0:13249:0:(genops.c:865:class_export_destroy()) destroying export ffff8e98746a2000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787136016.679085:0:13249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787136016.679183:0:13249:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import e67bffa2-3749-4eab-9303-62ad12948de4->MGS 00010000:00010000:2.0:1787136016.679198:0:13249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2021d4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f2021db expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787136016.679382:0:13249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2021d4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f2021db expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787136016.679389:0:13249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787136016.679391:0:13249:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787136016.679394:0:13249:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787136016.679410:0:13249:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e984747f800 00010000:00010000:2.0:1787136016.679414:0:13249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840031000/0xf5850c552f2021d4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf5850c552f2021db expref: -99 pid: 6670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136016.679445:0:13249:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9840031600/0xf5850c552f202420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf5850c552f202427 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787136016.679453:0:13249:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9840031600/0xf5850c552f202420 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf5850c552f202427 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787136016.679458:0:13249:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787136016.679461:0:13249:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787136016.679462:0:13249:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787136016.679472:0:13249:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e984747f800 00010000:00010000:2.0:1787136016.679474:0:13249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9840031600/0xf5850c552f202420 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf5850c552f202427 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787136016.679491:0:13249:0:(import.c:65:import_set_state_nolock()) ffff8e984747f800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787136016.679495:0:13249:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787136016.679497:0:13249:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787136016.679499:0:13249:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787136016.679503:0:13249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787136016.679514:0:13249:0:(client.c:3576:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e9881fa6680 x1873947616431232/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787136018 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787136016.679531:0:13249:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787136016.679534:0:13249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:0.0:1787136016.679623:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e67bffa2-3749-4eab-9303-62ad12948de4:3299:1873947616431232:0@lo:250:kworker.0 00000020:00000080:3.0:1787136016.679713:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e98746a7000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:2.0:1787136016.680184:0:13249:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787136016.680192:0:13249:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f2020b5 00000020:00000080:2.0:1787136016.680198:0:13249:0:(genops.c:906:class_export_put()) final put ffff8e984758d000/e67bffa2-3749-4eab-9303-62ad12948de4 00000020:01000000:2.0:1787136016.681305:0:13249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.138@tcp (flags='') 00000020:00000080:2.0:1787136016.681315:0:13249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787136016.681322:0:13249:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.138@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787136016.681327:0:13249:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8e9860760000) has no exports 00000020:00000080:3.0:1787136016.681419:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e984758d000/e67bffa2-3749-4eab-9303-62ad12948de4 for MGC192.168.203.138@tcp 10000000:01000000:0.0:1787136016.681554:0:5818:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787136016.681734:0:13249:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.138@tcp: client import never connected 00000100:00080000:2.0:1787136016.681747:0:13249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787136016.681750:0:13249:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787136016.681753:0:13249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787136016.681755:0:13249:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787136016.681812:0:13249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787136016.681826:0:13249:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.138@tcp (uuid e67bffa2-3749-4eab-9303-62ad12948de4) 00000020:01000000:2.0:1787136016.681832:0:13249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787136016.681836:0:13249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787136016.681840:0:13249:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787136016.681846:0:13249:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e9746922800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787136016.681852:0:13249:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff8e987c3f99c0) has exports, disconnecting them 00000020:00080000:2.0:1787136016.681855:0:13249:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e9746922800), last request at 1787135815 00000020:00000080:2.0:1787136016.681859:0:13249:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f2022ec 00000020:00080000:2.0:1787136016.681872:0:13249:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e9746922800): rc 0 00000020:00000080:2.0:1787136016.681876:0:13249:0:(genops.c:906:class_export_put()) final put ffff8e9746922800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787136016.682553:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e984747f800 for MGC192.168.203.138@tcp 00000020:00000080:3.0:1787136016.682562:0:38:0:(genops.c:906:class_export_put()) final put ffff8e98480d3800/e67bffa2-3749-4eab-9303-62ad12948de4 00000020:00000080:3.0:1787136016.682565:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e98480d3800/e67bffa2-3749-4eab-9303-62ad12948de4 for MGC192.168.203.138@tcp 00000020:01000000:3.0:1787136016.682569:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.138@tcp (e67bffa2-3749-4eab-9303-62ad12948de4) 00000020:00000080:3.0:1787136016.682780:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9746922800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1787136016.683870:0:13249:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1787136016.683877:0:13249:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787136016.683882:0:13249:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787136016.683888:0:13249:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1787136016.683989:0:5809:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:0.0:1787136016.684116:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e9746924000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1787136016.684296:0:5810:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1787136016.684603:0:5805:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e9852414200:5805] 1 exiting: rc = 0 00000100:00100000:0.0:1787136016.684690:0:5804:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e984f165200:5804] 0 exiting: rc = 1 00000100:00100000:3.0:1787136016.685813:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.686089:0:5806:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e9850595800:5806] 0 exiting: rc = 1 00000100:00100000:0.0:1787136016.686234:0:7612:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e9874827800:7612] 3 exiting: rc = 0 00000100:00100000:3.0:1787136016.687399:0:5808:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e984f164800:5808] 2 exiting: rc = 0 00000100:00100000:0.0:1787136016.688335:0:5807:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e984f039e00:5807] 1 exiting: rc = 0 00000100:00100000:3.0:1787136016.688440:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688448:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688454:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688460:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688465:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688471:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688477:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688482:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688487:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688492:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688498:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688504:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688511:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688516:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688539:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688545:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688552:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688558:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688562:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688568:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688573:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688578:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688582:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688587:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688591:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688596:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688600:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688605:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688609:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688614:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688619:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688624:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688629:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688634:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688639:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688644:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688649:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688655:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688660:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688665:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688670:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688675:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688680:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688685:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688690:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688696:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688701:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688706:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688710:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688723:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688729:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688734:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688739:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688744:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688749:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688755:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688760:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688774:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688780:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688785:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688789:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688794:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688799:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.688804:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787136016.690785:0:13249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787136016.690796:0:13249:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1787136016.690802:0:13249:0:(genops.c:906:class_export_put()) final put ffff8e9842bc7000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1787136016.690806:0:13249:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9842bc7000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1787136016.690812:0:13249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1787136016.690866:0:13249:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e9744a91800 1 00000020:00000080:3.0:1787136016.690872:0:13249:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf5850c552f202291 00000020:00000080:3.0:1787136016.690877:0:13249:0:(genops.c:906:class_export_put()) final put ffff8e9852f6f000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1787136016.690892:0:13249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1787136016.690897:0:13249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787136016.690902:0:13249:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787136016.690913:0:13249:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8e987c3fb380) has no exports 00000020:00000080:0.0:1787136016.691396:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9852f6f000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787136016.718134:0:13249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787136016.718150:0:13249:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787136016.718155:0:13249:0:(genops.c:906:class_export_put()) final put ffff8e9745129000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787136016.718160:0:13249:0:(genops.c:865:class_export_destroy()) destroying export ffff8e9745129000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787136016.718172:0:13249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787136016.718447:0:13249:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e9744a94800 00000020:01000000:3.0:1787136016.718480:0:13249:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787136016.718485:0:13249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787136016.718489:0:13249:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787136016.718493:0:13249:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8e98607619c0) has no exports 00000020:00000080:3.0:1787136016.718516:0:13249:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787136016.718522:0:13249:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787136016.718525:0:13249:0:(genops.c:906:class_export_put()) final put ffff8e987c6e6000/OSS_uuid 00000020:00000080:3.0:1787136016.718528:0:13249:0:(genops.c:865:class_export_destroy()) destroying export ffff8e987c6e6000/OSS_uuid for OSS 00000020:01000000:3.0:1787136016.718532:0:13249:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787136016.718602:0:12502:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8e9744a8aa00:12502] 4 exiting: rc = 0 00000100:00100000:3.0:1787136016.718684:0:6674:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8e98463e2000:6674] 2 exiting: rc = 0 00000100:00100000:3.0:1787136016.720488:0:11994:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8e9876a0cc00:11994] 3 exiting: rc = 0 00000100:00100000:3.0:1787136016.724642:0:6672:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8e984945ac00:6672] 0 exiting: rc = 1 00000100:00100000:3.0:1787136016.724749:0:6673:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8e98463e3e00:6673] 1 exiting: rc = 0 00000100:00080000:3.0:1787136016.724804:0:5817:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1787136016.724944:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.724954:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.724963:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.724972:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.724981:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.724989:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.724998:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725007:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725144:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725156:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725164:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725172:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725181:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725186:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725191:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725196:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725201:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725207:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725212:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725231:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725236:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725241:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725247:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725257:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725262:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725268:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725272:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725277:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725283:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725290:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725295:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725300:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725305:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725315:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725322:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725329:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725338:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725343:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725348:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725353:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725359:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725364:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725369:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725375:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725396:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725401:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725405:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725410:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725415:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725420:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725424:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725429:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725434:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725440:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725453:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725457:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725462:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725467:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725471:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725476:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725480:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725486:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725491:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.725497:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.727148:0:9726:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8e9874201000:9726] 2 exiting: rc = 0 00000100:00100000:3.0:1787136016.727196:0:6676:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e9873a99800:6676] 0 exiting: rc = 1 00000100:00100000:0.0:1787136016.729588:0:6677:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e9873aa7000:6677] 1 exiting: rc = 0 00000100:00100000:3.0:1787136016.729964:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.729973:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.729978:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.729983:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.729987:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.729991:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.729995:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730000:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730005:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730010:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730015:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730020:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730025:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730030:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730034:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730039:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730045:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730073:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730079:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730084:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730088:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730093:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730098:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730103:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730122:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730127:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730132:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730137:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730142:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730147:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730156:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730162:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730167:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730171:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730176:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730186:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730191:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730195:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730200:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730205:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730210:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730215:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730220:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730225:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730230:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730235:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730240:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730251:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730256:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730263:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730268:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730274:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730279:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730283:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730288:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730294:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730299:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730304:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730310:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730322:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730327:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730335:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730343:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.730348:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.731483:0:6678:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e9873aa7400:6678] 0 exiting: rc = 1 00000100:00100000:0.0:1787136016.732175:0:6679:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e9873aa6c00:6679] 1 exiting: rc = 0 00000100:00100000:0.0:1787136016.733083:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e9873a98a00:6680] 2 exiting: rc = 0 00000100:00100000:3.0:1787136016.733159:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733169:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733175:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733181:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733187:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733193:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733199:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733205:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733210:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733215:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733221:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733227:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733232:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733238:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733243:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733248:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733253:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733259:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733277:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733284:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733290:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733295:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733300:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733306:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733311:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733316:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733322:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733328:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733334:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733351:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733357:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733362:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733367:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733373:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733393:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733400:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733406:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733412:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733417:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733423:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733429:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733435:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733456:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733462:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733467:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733472:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733479:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733486:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733493:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733499:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733506:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733513:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733520:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733526:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733532:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733539:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733547:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733557:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733569:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733576:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733581:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733587:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733594:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787136016.733599:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787136016.766524:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e9873a99000:6681] 0 exiting: rc = 1 00000100:00100000:0.0:1787136016.768160:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e9873a98000:6682] 1 exiting: rc = 0 00000100:00100000:0.0:1787136016.768264:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768283:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768289:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768293:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768298:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768303:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768309:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768314:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768319:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768325:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768330:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768335:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768341:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768346:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768352:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768357:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768362:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768368:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768373:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768601:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768610:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768615:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768620:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768625:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768644:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768650:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768655:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768660:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768664:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768669:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768674:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768679:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768684:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768689:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768694:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768700:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768704:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768709:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768715:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768720:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768725:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768731:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768737:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768742:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768747:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768752:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768756:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768761:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768766:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768770:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768775:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768779:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768784:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768789:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768795:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768799:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768804:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768811:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768817:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768830:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768835:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768840:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768844:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.768849:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787136016.770764:0:6683:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e9873aa7800:6683] 0 exiting: rc = 1 00000100:00100000:3.0:1787136016.771143:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e9873aa6a00:6684] 1 exiting: rc = 0 00000100:00100000:0.0:1787136016.771374:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771400:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771407:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771412:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771418:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771425:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771430:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771437:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771443:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771448:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771453:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771458:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771475:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771496:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771503:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771509:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771514:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771519:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771525:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771530:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771536:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771541:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771546:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771552:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771556:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771575:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771585:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771590:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771595:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771601:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771617:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771623:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771629:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771634:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771640:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771648:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771654:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771678:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771685:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771690:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771697:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771703:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771709:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771715:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771721:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771727:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771733:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771739:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771746:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771767:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771774:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771779:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771785:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771791:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771797:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771802:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771809:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771814:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771840:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771857:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771864:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771890:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771898:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787136016.771913:0:13249:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787136016.801214:0:13249:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1787136033.447631:0:13865:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1787136042.537079:0:14325:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787136042.537094:0:14325:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1787136042.537192:0:14325:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e9876a4d800 00000020:01000004:0.0:1787136042.537208:0:14325:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1787136042.537216:0:14325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787136042.537230:0:14325:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e987c3fcd40) 00000020:00000080:0.0:1787136042.537243:0:14325:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787136042.550531:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787136042.553385:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1787136042.553904:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 343: rc = 0 00100000:10000000:0.0:1787136042.554002:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 343: rc = 0 00100000:10000000:0.0:1787136042.554213:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787136042.554284:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 343: rc = 0 00100000:10000000:0.0:1787136042.554382:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 343: rc = 0 00100000:10000000:0.0:1787136042.554555:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 343: rc = 0 00100000:10000000:0.0:1787136042.554744:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 343: rc = 0 00100000:10000000:0.0:1787136042.554992:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 345: rc = 0 00100000:10000000:0.0:1787136042.561972:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 16: rc = 0 00100000:10000000:0.0:1787136042.562105:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 16: rc = 0 00100000:10000000:0.0:1787136042.562749:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 591: rc = 0 00100000:10000000:0.0:1787136042.563269:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1787136042.563676:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 591: rc = 0 00100000:10000000:0.0:1787136042.563935:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 591: rc = 0 00100000:10000000:0.0:1787136042.564216:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1787136042.564544:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1787136042.564893:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1787136042.565241:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 591: rc = 0 00100000:10000000:0.0:1787136042.565554:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1787136042.565890:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 591: rc = 0 00100000:10000000:0.0:1787136042.566186:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 591: rc = 0 00100000:10000000:0.0:1787136042.566502:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 591: rc = 0 00100000:10000000:0.0:1787136042.566985:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 671: rc = 0 00100000:10000000:0.0:1787136042.567502:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 671: rc = 0 00100000:10000000:0.0:1787136042.567837:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 671: rc = 0 00100000:10000000:0.0:1787136042.568226:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 671: rc = 0 00100000:10000000:0.0:1787136042.568544:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 671: rc = 0 00100000:10000000:0.0:1787136042.568886:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 671: rc = 0 00100000:10000000:0.0:1787136042.569216:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 671: rc = 0 00100000:10000000:0.0:1787136042.569532:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 671: rc = 0 00100000:10000000:0.0:1787136042.569851:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 671: rc = 0 00100000:10000000:0.0:1787136042.570195:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 671: rc = 0 00100000:10000000:0.0:1787136042.570511:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 671: rc = 0 00100000:10000000:0.0:1787136042.570846:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 671: rc = 0 00100000:10000000:0.0:1787136042.571285:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 671: rc = 0 00100000:10000000:0.0:1787136042.571701:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 671: rc = 0 00100000:10000000:0.0:1787136042.571969:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 671: rc = 0 00100000:10000000:0.0:1787136042.572250:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 671: rc = 0 00100000:10000000:0.0:1787136042.572565:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 671: rc = 0 00100000:10000000:0.0:1787136042.572930:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 671: rc = 0 00100000:10000000:1.0:1787136042.573398:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 671: rc = 0 00100000:10000000:1.0:1787136042.573808:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 671: rc = 0 00100000:10000000:1.0:1787136042.574258:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 671: rc = 0 00100000:10000000:1.0:1787136042.574580:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 671: rc = 0 00100000:10000000:1.0:1787136042.574916:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 671: rc = 0 00100000:10000000:1.0:1787136042.575181:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 671: rc = 0 00100000:10000000:1.0:1787136042.575664:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 671: rc = 0 00100000:10000000:1.0:1787136042.575943:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 671: rc = 0 00100000:10000000:1.0:1787136042.576208:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 671: rc = 0 00100000:10000000:1.0:1787136042.576770:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 671: rc = 0 00100000:10000000:1.0:1787136042.577020:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 671: rc = 0 00100000:10000000:1.0:1787136042.577303:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 671: rc = 0 00100000:10000000:1.0:1787136042.577697:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 671: rc = 0 00100000:10000000:1.0:1787136042.577961:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 671: rc = 0 00100000:10000000:1.0:1787136042.578346:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 667: rc = 0 00100000:10000000:1.0:1787136042.578981:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1787136042.579181:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 17: rc = 0 00100000:10000000:1.0:1787136042.579379:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1787136042.579523:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 17: rc = 0 00100000:10000000:1.0:1787136042.579794:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1787136042.579866:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 17: rc = 0 00100000:10000000:1.0:1787136042.580313:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1787136042.580386:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 588: rc = 0 00100000:10000000:1.0:1787136042.580713:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1787136042.580795:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 588: rc = 0 00100000:10000000:1.0:1787136042.580979:0:14325:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1787136042.581122:0:14325:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 588: rc = 0 00000020:00000080:1.0:1787136042.581396:0:14325:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1787136042.581404:0:14325:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787136042.581415:0:14325:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f2033bd 00000020:01000004:1.0:1787136042.581487:0:14325:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1787136042.581493:0:14325:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1787136042.581500:0:14325:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e9876a4d800 from MGS 00000020:01000004:1.0:1787136042.581503:0:14325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1787136042.581513:0:14325:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e9874183380) 00000020:00000080:1.0:1787136042.581523:0:14325:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1787136042.581578:0:14325:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e9876a4d800 from MGS, refs=2 00080000:01000000:1.0:1787136042.581654:0:14325:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787136042.581662:0:14325:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f2033cb 00000100:00100000:1.0:1787136042.581763:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1787136042.581889:0:14325:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1787136042.581895:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1787136042.582516:0:14325:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1787136042.582523:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787136042.583223:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787136042.583375:0:14325:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787136042.583382:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1787136042.583932:0:14325:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1787136042.583940:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787136042.584394:0:14325:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787136042.584401:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787136042.585165:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136042.585169:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136042.585171:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136042.585433:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136042.585436:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136042.585438:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136042.585987:0:14325:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787136042.593242:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787136042.596387:0:14325:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787136042.596405:0:14325:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787136042.596408:0:14325:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787136042.598667:0:14334:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787136042.598828:0:14325:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787136042.598929:0:14325:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787136042.600159:0:14325:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787136042.600475:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787136042.600708:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787136042.600714:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787136042.607372:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787136042.607388:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787136042.608346:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787136042.608354:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1787136042.609138:0:14339:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1787136042.609278:0:14325:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787136042.609300:0:14325:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.138@tcp' 00000020:01000004:2.0:1787136042.609302:0:14325:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787136042.609333:0:14325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.138@tcp (typ=mgc) 00000020:00000080:2.0:1787136042.609346:0:14325:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.138@tcp (ffff8e98434699c0) 00000020:00000080:2.0:1787136042.609363:0:14325:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787136042.609502:0:14325:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8e97449a6000@MGC192.168.203.138@tcp: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1787136042.609805:0:14325:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.138@tcp-0 is initialized 00000040:01000000:2.0:1787136042.609812:0:14325:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787136042.610341:0:14340:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787136042.610401:0:14325:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.138@tcp (uuid 247d1cf6-e699-400d-82b2-f0faea63f3e6) 00000020:00000080:2.0:1787136042.610417:0:14325:0:(genops.c:1406:class_connect()) connect: client 247d1cf6-e699-400d-82b2-f0faea63f3e6, cookie 0xf5850c552f2033d9 00000100:00080000:2.0:1787136042.610437:0:14325:0:(import.c:510:import_select_connection()) MGC192.168.203.138@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787136042.610443:0:14325:0:(import.c:624:import_select_connection()) MGC192.168.203.138@tcp: import ffff8e97449a6000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1787136042.610473:0:14325:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9876bd1f80 x1873947616431616/t0(0) o250->MGC192.168.203.138@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787136042.610499:0:14325:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 247d1cf6-e699-400d-82b2-f0faea63f3e6->MGS 00000020:01000004:2.0:1787136042.610519:0:14325:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787136042.610524:0:14325:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787136042.610534:0:14325:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e984346cd40) 00000020:00000080:2.0:1787136042.610542:0:14325:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787136042.610712:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:247d1cf6-e699-400d-82b2-f0faea63f3e6:3299:1873947616431616:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787136042.610782:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136042.610859:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616431616 00000100:00100000:0.0:1787136042.610866:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616431616 00000100:00100000:0.0:1787136042.610897:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787136042.610904:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3299:x1873947616431616:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787136042.610925:0:14335:0:(ldlm_lib.c:1449:target_handle_connect()) MGS: connection from 247d1cf6-e699-400d-82b2-f0faea63f3e6@0@lo t0 exp 0000000000000000 cur 402 last 0 00000020:00000080:0.0:1787136042.610950:0:14335:0:(genops.c:1406:class_connect()) connect: client 247d1cf6-e699-400d-82b2-f0faea63f3e6, cookie 0xf5850c552f2033e7 00000100:00080000:0.0:1787136042.611083:0:14335:0:(import.c:65:import_set_state_nolock()) ffff8e9876a4b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787136042.611133:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+5:3299:x1873947616431616:12345-0@lo:250:mount.lustre.0 Request processed in 227us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136042.611141:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787136042.611180:0:3299:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.138@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787136042.611188:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.138@tcp: connect to target with instance 0 00000100:00080000:0.0:1787136042.611195:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.138@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787136042.611198:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787136042.611201:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e97449a6000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787136042.611203:0:3299:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787136042.611211:0:3299:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787136042.611215:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:247d1cf6-e699-400d-82b2-f0faea63f3e6:3299:1873947616431616:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787136042.627404:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787136042.629773:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787136042.629781:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787136042.632752:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787136042.632763:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787136042.633221:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787136042.633229:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787136042.633984:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787136042.634354:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787136042.634360:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787136042.634905:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787136042.634912:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787136042.664143:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787136042.664349:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787136042.664356:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787136042.665674:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787136042.665683:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787136042.666322:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787136042.666485:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787136042.666492:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787136042.667009:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787136042.667016:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787136042.667577:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787136042.667804:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787136042.667809:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787136042.668263:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787136042.668271:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787136042.669261:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787136042.669413:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787136042.669418:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1787136042.670027:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787136042.670034:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1787136042.685787:0:14325:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787136042.685978:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787136042.685985:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787136042.691266:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787136042.691286:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787136042.692224:0:14325:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787136042.692234:0:14325:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1787136042.693102:0:14325:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1787136042.693125:0:14325:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1787136042.693132:0:14325:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1787136042.693270:0:14325:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787136042.693304:0:14325:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1787136042.693309:0:14325:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787136042.693311:0:14325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787136042.693312:0:14325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787136042.693313:0:14325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787136042.693315:0:14325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787136042.693316:0:14325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787136042.693318:0:14325:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787136042.693319:0:14325:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787136042.693321:0:14325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787136042.693323:0:14325:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787136042.693326:0:14325:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1787136042.693328:0:14325:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787136042.693329:0:14325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787136042.693330:0:14325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787136042.693331:0:14325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787136042.693332:0:14325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787136042.693333:0:14325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787136042.693334:0:14325:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787136042.693335:0:14325:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787136042.693337:0:14325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787136042.693338:0:14325:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787136042.693364:0:14325:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787136042.693385:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616431744:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787136042.693678:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.693766:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9860782300 going to sleep for 11 seconds 00000100:00100000:1.0:1787136042.693916:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616431744 00000100:00100000:1.0:1787136042.693928:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616431744 00000100:00100000:1.0:1787136042.694002:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787136042.694012:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+5:14325:x1873947616431744:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787136042.694078:0:14338:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787136042.694082:0:14338:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787136042.694085:0:14338:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787136042.694396:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787136042.694881:0:14338:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787136042.695886:0:14360:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787136042.695893:0:14360:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787136042.695896:0:14360:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787136042.695932:0:14360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1787136042.696187:0:14338:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787136042.696196:0:14338:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1787136042.705774:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+5:14325:x1873947616431744:12345-0@lo:253:mount.lustre.0 Request processed in 11756us (12089us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136042.705788:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787136042.705869:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616431744:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787136042.705884:0:14325:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787136042.705887:0:14325:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787136042.705889:0:14325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787136042.705890:0:14325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787136042.705892:0:14325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787136042.705893:0:14325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787136042.705894:0:14325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787136042.705895:0:14325:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787136042.705908:0:14325:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787136042.705910:0:14325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787136042.705911:0:14325:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787136042.705929:0:14325:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e9876a4d800 from lustre-MDT0000 10000000:01000000:2.0:1787136042.705953:0:14325:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787136042.705955:0:14325:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787136042.705960:0:14325:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e98434699c0 10000000:01000000:2.0:1787136042.705964:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787136042.705971:0:14325:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff8e98434699c0 from 1 10000000:01000000:2.0:1787136042.705974:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787136042.706010:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.706021:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.706029:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136042.706214:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616431872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787136042.706256:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.706325:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9860782d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787136042.706371:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616431872 00000100:00100000:0.0:1787136042.706378:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616431872 00000100:00100000:0.0:1787136042.706506:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787136042.706516:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+5:14325:x1873947616431872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787136042.706530:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787136042.706546:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9874897200/0xf5850c552f2033f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2033ee expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136042.706568:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9874897200/0xf5850c552f2033f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2033ee expref: 6 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136042.706578:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9874897200/0xf5850c552f2033f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2033ee expref: 6 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136042.706668:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897200, rc 0) 00000100:00100000:0.0:1787136042.706757:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+6:14325:x1873947616431872:12345-0@lo:101:mount.lustre.0 Request processed in 243us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136042.706764:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787136042.706836:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616431872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787136042.706849:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2033f5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.706857:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2033f5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136042.706902:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616432000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787136042.706936:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.706987:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9860782d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787136042.707024:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616432000 00000100:00100000:0.0:1787136042.707028:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616432000 00000100:00100000:0.0:1787136042.707084:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787136042.707091:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+6:14325:x1873947616432000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787136042.707305:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+6:14325:x1873947616432000:12345-0@lo:501:mount.lustre.0 Request processed in 214us (367us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787136042.707312:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787136042.707390:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616432000:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787136042.707414:0:14325:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787136042.707489:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2033f5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.707498:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2033f5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787136042.707518:0:14325:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e9876a4d800 10000000:01000000:3.0:1787136042.707522:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787136042.707527:0:14325:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e9876a4d800 10000000:01000000:3.0:1787136042.707529:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787136042.707532:0:14325:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff8e9876a4d800 from 1 10000000:01000000:3.0:1787136042.707534:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787136042.707555:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98820e2200/0xf5850c552f2033fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.707562:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98820e2200/0xf5850c552f2033fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.707571:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98820e2200/0xf5850c552f2033fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136042.707585:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616432128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787136042.707682:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136042.707695:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843508d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787136042.707763:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616432128 00000100:00100000:2.0:1787136042.707767:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616432128 00000100:00100000:2.0:1787136042.707788:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787136042.707793:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+6:14325:x1873947616432128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787136042.707801:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787136042.707813:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98413cb200/0xf5850c552f203403 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2033fc expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.707828:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98413cb200/0xf5850c552f203403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2033fc expref: 7 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.707837:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98413cb200/0xf5850c552f203403 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2033fc expref: 7 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.707843:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98413cb200, rc 0) 00000100:00100000:2.0:1787136042.707883:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+7:14325:x1873947616432128:12345-0@lo:101:mount.lustre.0 Request processed in 89us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136042.707889:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787136042.707989:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616432128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787136042.708000:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98820e2200/0xf5850c552f2033fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203403 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.708009:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98820e2200/0xf5850c552f2033fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f203403 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787136042.708020:0:14325:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787136042.708034:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98820e2200/0xf5850c552f2033fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203403 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.708073:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98820e2200/0xf5850c552f2033fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203403 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787136042.708080:0:14325:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787136042.708084:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787136042.708088:0:14325:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e9876a4d800 10000000:01000000:3.0:1787136042.708090:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787136042.708093:0:14325:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787136042.708095:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787136042.708110:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98820e3e00/0xf5850c552f20340a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.708117:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98820e3e00/0xf5850c552f20340a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.708124:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98820e3e00/0xf5850c552f20340a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136042.708136:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616432256:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787136042.708160:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136042.708179:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843508d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787136042.708227:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616432256 00000100:00100000:2.0:1787136042.708232:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616432256 00000100:00100000:2.0:1787136042.708262:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787136042.708269:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+7:14325:x1873947616432256:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787136042.708277:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787136042.708284:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98413cb400/0xf5850c552f203411 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20340a expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.708298:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98413cb400/0xf5850c552f203411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20340a expref: 8 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.708313:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98413cb400/0xf5850c552f203411 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20340a expref: 8 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.708319:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98413cb400, rc 0) 00000100:00100000:2.0:1787136042.708346:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+8:14325:x1873947616432256:12345-0@lo:101:mount.lustre.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136042.708352:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787136042.708420:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616432256:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787136042.708496:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98820e3e00/0xf5850c552f20340a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203411 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.708503:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98820e3e00/0xf5850c552f20340a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f203411 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136042.708552:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616432384:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787136042.708577:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136042.708698:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843508d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787136042.708796:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616432384 00000100:00100000:2.0:1787136042.708801:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616432384 00000100:00100000:2.0:1787136042.708858:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787136042.708865:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+8:14325:x1873947616432384:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787136042.709224:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+9:14325:x1873947616432384:12345-0@lo:501:mount.lustre.0 Request processed in 359us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136042.709231:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787136042.709314:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616432384:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787136042.709342:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616432512:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787136042.709380:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136042.709402:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874107480 going to sleep for 11 seconds 00000100:00100000:1.0:1787136042.709529:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616432512 00000100:00100000:1.0:1787136042.709534:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616432512 00000100:00100000:1.0:1787136042.709556:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787136042.709562:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+9:14325:x1873947616432512:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787136042.709992:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+9:14325:x1873947616432512:12345-0@lo:503:mount.lustre.0 Request processed in 429us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136042.710000:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787136042.710512:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616432512:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787136042.711042:0:14361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:247d1cf6-e699-400d-82b2-f0faea63f3e6:14361:1873947616432640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787136042.711217:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136042.711290:0:14361:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9852b199c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787136042.711330:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616432640 00000100:00100000:0.0:1787136042.711336:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616432640 00000100:00100000:0.0:1787136042.711410:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787136042.711419:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+9:14361:x1873947616432640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787136042.712003:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+9:14361:x1873947616432640:12345-0@lo:502:llog_process_th.0 Request processed in 584us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136042.712012:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787136042.712181:0:14361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:247d1cf6-e699-400d-82b2-f0faea63f3e6:14361:1873947616432640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787136042.712206:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787136042.712217:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787136042.712219:0:14361:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787136042.712224:0:14361:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1787136042.712227:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787136042.712245:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e98741819c0) 00000020:00000080:1.0:1787136042.712264:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1787136042.712269:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1787136042.712334:0:14361:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:1.0:1787136042.712341:0:14361:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f20341f 00000020:00000080:1.0:1787136042.712695:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1787136042.712700:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787136042.712704:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787136042.712705:0:14361:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1787136042.712708:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787136042.712711:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787136042.712712:0:14361:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1787136042.712715:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787136042.712722:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e9874184d40) 00000020:00000080:1.0:1787136042.712743:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1787136042.712748:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1787136042.712750:0:14361:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1787136042.712752:0:14361:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1787136042.712757:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787136042.712795:0:14361:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e9876a4d800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1787136042.712807:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e9874180000) 00000020:00000080:1.0:1787136042.712813:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1787136042.712848:0:14361:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1787136042.712853:0:14361:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5850c552f203434 00000020:00000080:1.0:1787136042.712939:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1787136042.712945:0:14361:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1787136042.712950:0:14361:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf5850c552f20343b 00080000:01000000:1.0:1787136042.712954:0:14361:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:1.0:1787136042.712960:0:14361:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f203442 00010000:00010000:0.0:1787136042.788809:0:14361:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1787136042.790187:0:14361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1787136042.790558:0:14361:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787136042.793538:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e987c3f8000) 00000020:00000080:0.0:1787136042.793560:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787136042.793671:0:14361:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787136042.793679:0:14361:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f203450 00000020:00000080:0.0:1787136042.794379:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787136042.802035:0:14361:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf5850c552f203457 00000020:00000080:2.0:1787136042.807443:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787136042.807457:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787136042.807466:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.807468:0:14361:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787136042.807472:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787136042.807479:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.807480:0:14361:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787136042.807485:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787136042.807530:0:14361:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787136042.807546:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787136042.807550:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.807551:0:14361:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787136042.807553:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787136042.807569:0:14361:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1787136042.807571:0:14361:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787136042.807573:0:14361:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787136042.807574:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787136042.807577:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.807579:0:14361:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787136042.807582:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787136042.807585:0:14361:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787136042.807589:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.807590:0:14361:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787136042.807594:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787136042.807600:0:14361:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:2.0:1787136042.807627:0:14361:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787136042.807630:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787136042.807645:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e9843468000) 00000020:00000080:2.0:1787136042.807662:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1787136042.807668:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787136042.807722:0:14361:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787136042.807736:0:14361:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787136042.807744:0:14361:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f203465 00010000:00080000:2.0:1787136042.807774:0:14361:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8e9865ef9800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1787136042.807998:0:14361:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1787136042.808410:0:14361:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787136042.808456:0:14361:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787136042.809386:0:14361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787136042.809449:0:14361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1787136042.809522:0:14361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787136042.812519:0:14365:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787136042.812526:0:14365:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1787136042.813650:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787136042.813662:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787136042.813695:0:14361:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1787136042.813713:0:14361:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5850c552f20346c 00000100:00080000:2.0:1787136042.813723:0:14361:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787136042.813747:0:14361:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e9865ef9800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1787136042.813783:0:14361:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9876bd1c00 x1873947616432768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787136042.813844:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616432768:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787136042.813898:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873947616432768 offset 0 length 520: 4 00000100:00080000:2.0:1787136042.813959:0:14361:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1787136042.814079:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787136042.814084:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.814086:0:14361:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1787136042.814088:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787136042.814091:0:14361:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787136042.814093:0:14361:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787136042.814094:0:14361:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787136042.814096:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787136042.814098:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.814100:0:14361:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787136042.814102:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787136042.814106:0:14361:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787136042.814109:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.814110:0:14361:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787136042.814113:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787136042.814117:0:14361:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.138@tcp to nid 0x20000c0a8cb8a (192.168.203.138@tcp) 00000020:01000000:2.0:1787136042.814137:0:14361:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787136042.814139:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787136042.814150:0:14361:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e984346b380) 00000020:00000080:2.0:1787136042.814161:0:14361:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1787136042.814177:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787136042.814228:0:14361:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787136042.814233:0:14361:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787136042.814239:0:14361:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf5850c552f20347a 00010000:00080000:2.0:1787136042.814282:0:14361:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8e98496a4800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:2.0:1787136042.814517:0:14361:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1787136042.814685:0:14361:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1787136042.814713:0:14361:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787136042.815172:0:14361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787136042.815235:0:14361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1787136042.815301:0:14361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787136042.816223:0:14367:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787136042.816229:0:14367:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787136042.817362:0:14361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787136042.817375:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787136042.817409:0:14361:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787136042.817428:0:14361:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5850c552f203481 00000100:00080000:2.0:1787136042.817439:0:14361:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787136042.817445:0:14361:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e98496a4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1787136042.817479:0:14361:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9876bd2d80 x1873947616432896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787136042.817504:0:14361:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787136042.817554:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787136042.817559:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.817561:0:14361:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787136042.817564:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787136042.817567:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.817569:0:14361:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787136042.817572:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787136042.817574:0:14361:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787136042.817576:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787136042.817579:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.817580:0:14361:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787136042.817583:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787136042.817585:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.817587:0:14361:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787136042.817590:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787136042.817620:0:14361:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:247d1cf6-e699-400d-82b2-f0faea63f3e6:14361:1873947616433024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787136042.817694:0:14361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.817739:0:14361:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98435f0240 going to sleep for 11 seconds 00000100:00100000:0.0:1787136042.817801:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616432896:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787136042.817831:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873947616432896 offset 0 length 520: 4 00000100:00100000:3.0:1787136042.817922:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616433024 00000100:00100000:3.0:1787136042.817929:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616433024 00000100:00100000:3.0:1787136042.817970:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787136042.817979:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+9:14361:x1873947616433024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787136042.818232:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+9:14361:x1873947616433024:12345-0@lo:502:llog_process_th.0 Request processed in 253us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136042.818240:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787136042.818359:0:14361:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:247d1cf6-e699-400d-82b2-f0faea63f3e6:14361:1873947616433024:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787136042.818384:0:14361:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787136042.818390:0:14361:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136042.818391:0:14361:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787136042.818395:0:14361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787136042.818540:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787136042.818563:0:14325:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787136042.818583:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98820e3e00/0xf5850c552f20340a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203411 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.818594:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98820e3e00/0xf5850c552f20340a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203411 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787136042.818602:0:14325:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e9876a4d800 from 1 10000000:01000000:3.0:1787136042.818605:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787136042.818630:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.818648:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.818658:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136042.818673:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616433152:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787136042.818701:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136042.818720:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787136042.818780:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616433152 00000100:00100000:0.0:1787136042.818785:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616433152 00000100:00100000:0.0:1787136042.818816:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787136042.818823:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+9:14325:x1873947616433152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787136042.818832:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787136042.818847:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9874896400/0xf5850c552f20348f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f203488 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136042.818868:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9874896400/0xf5850c552f20348f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f203488 expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136042.818879:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9874896400/0xf5850c552f20348f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203488 expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136042.818887:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896400, rc 0) 00000100:00100000:0.0:1787136042.818928:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+10:14325:x1873947616433152:12345-0@lo:101:mount.lustre.0 Request processed in 106us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136042.818941:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787136042.819032:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616433152:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787136042.819071:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20348f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.819082:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20348f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136042.819603:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616433280:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787136042.819644:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.819667:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98435f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787136042.819774:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616433280 00000100:00100000:3.0:1787136042.819780:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616433280 00000100:00100000:3.0:1787136042.819813:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787136042.819821:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+10:14325:x1873947616433280:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1787136042.819837:0:14335:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1787136042.819843:0:14335:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1787136042.819914:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+10:14325:x1873947616433280:12345-0@lo:256:mount.lustre.0 Request processed in 94us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136042.819920:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787136042.820015:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616433280:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787136042.820630:0:14325:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787136042.822494:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20348f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.822512:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20348f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787136042.822521:0:14325:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e9876a4d800 from 1 10000000:01000000:2.0:1787136042.822524:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787136042.822566:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.822591:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.822603:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136042.822628:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616433408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787136042.822689:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.822735:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98435f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787136042.823142:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616433408 00000100:00100000:3.0:1787136042.823151:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616433408 00000100:00100000:3.0:1787136042.823209:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787136042.823218:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+10:14325:x1873947616433408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787136042.823232:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136042.823247:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98820e3400/0xf5850c552f20349d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f203496 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.823269:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98820e3400/0xf5850c552f20349d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f203496 expref: 11 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.823286:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98820e3400/0xf5850c552f20349d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203496 expref: 11 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136042.823295:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e3400, rc 0) 00000100:00100000:3.0:1787136042.823337:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14325:x1873947616433408:12345-0@lo:101:mount.lustre.0 Request processed in 120us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136042.823345:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787136042.823525:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616433408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787136042.823539:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20349d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.823548:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20349d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136042.823600:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616433536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787136042.823628:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.823653:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98435f0240 going to sleep for 11 seconds 00000100:00100000:0.0:1787136042.823980:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616433536 00000100:00100000:0.0:1787136042.823986:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616433536 00000100:00100000:0.0:1787136042.824022:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787136042.824030:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14325:x1873947616433536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787136042.824440:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14325:x1873947616433536:12345-0@lo:501:mount.lustre.0 Request processed in 409us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136042.824448:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787136042.824648:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616433536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787136042.824685:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616433664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787136042.824724:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.824756:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98435f0240 going to sleep for 11 seconds 00000100:00100000:3.0:1787136042.824803:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616433664 00000100:00100000:3.0:1787136042.824808:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616433664 00000100:00100000:3.0:1787136042.824840:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787136042.824848:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14325:x1873947616433664:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787136042.824992:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14325:x1873947616433664:12345-0@lo:503:mount.lustre.0 Request processed in 145us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136042.824999:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787136042.825135:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616433664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787136042.825515:0:14369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:247d1cf6-e699-400d-82b2-f0faea63f3e6:14369:1873947616433792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787136042.825552:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136042.825582:0:14369:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f6cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787136042.825629:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616433792 00000100:00100000:3.0:1787136042.825634:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616433792 00000100:00100000:3.0:1787136042.825665:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787136042.825672:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14369:x1873947616433792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787136042.825863:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14369:x1873947616433792:12345-0@lo:502:llog_process_th.0 Request processed in 191us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136042.825870:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787136042.825941:0:14369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:247d1cf6-e699-400d-82b2-f0faea63f3e6:14369:1873947616433792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787136042.825964:0:14369:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787136042.825973:0:14369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136042.825976:0:14369:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787136042.825982:0:14369:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e9876a4d800 00000020:00000080:0.0:1787136042.825984:0:14369:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787136042.825992:0:14369:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787136042.825994:0:14369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136042.825996:0:14369:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787136042.825998:0:14369:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787136042.826000:0:14369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136042.826002:0:14369:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787136042.826005:0:14369:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e9876a4d800 00000020:00000080:0.0:1787136042.826008:0:14369:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787136042.826087:0:14369:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787136042.826091:0:14369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136042.826092:0:14369:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787136042.826101:0:14369:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787136042.826104:0:14369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136042.826105:0:14369:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787136042.826109:0:14369:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e9876a4d800 00000020:00000080:0.0:1787136042.826111:0:14369:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787136042.826146:0:14369:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:247d1cf6-e699-400d-82b2-f0faea63f3e6:14369:1873947616433920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787136042.826345:0:14369:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136042.826362:0:14369:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f6cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787136042.826424:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616433920 00000100:00100000:2.0:1787136042.826435:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616433920 00000100:00100000:2.0:1787136042.826461:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787136042.826468:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14369:x1873947616433920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787136042.826610:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14369:x1873947616433920:12345-0@lo:502:llog_process_th.0 Request processed in 142us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136042.826617:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787136042.827271:0:14369:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:247d1cf6-e699-400d-82b2-f0faea63f3e6:14369:1873947616433920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787136042.827313:0:14369:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787136042.827319:0:14369:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136042.827321:0:14369:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1787136042.827325:0:14369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787136042.827540:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787136042.827557:0:14325:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787136042.827575:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20349d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.827584:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20349d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787136042.827623:0:14325:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787136042.827626:0:14325:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e9876a4d800 10000000:01000000:2.0:1787136042.827629:0:14325:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e9876a4d800 10000000:01000000:2.0:1787136042.827633:0:14325:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787136042.827638:0:14325:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e9876a4d800 from 1 10000000:01000000:2.0:1787136042.827640:0:14325:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787136042.827668:0:14325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2034a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.827676:0:14325:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2034a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.827685:0:14325:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2034a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136042.827702:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616434048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787136042.827762:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.827789:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98435f0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787136042.827836:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616434048 00000100:00100000:1.0:1787136042.827842:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616434048 00000100:00100000:1.0:1787136042.827876:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787136042.827884:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14325:x1873947616434048:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787136042.827905:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136042.827922:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98533af000/0xf5850c552f2034ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2034a4 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136042.827945:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98533af000/0xf5850c552f2034ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2034a4 expref: 12 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136042.827956:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98533af000/0xf5850c552f2034ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2034a4 expref: 12 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136042.827964:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533af000, rc 0) 00000100:00100000:1.0:1787136042.827995:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14325:x1873947616434048:12345-0@lo:101:mount.lustre.0 Request processed in 112us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136042.828002:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787136042.828437:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616434048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787136042.828451:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2034a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2034ab expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.828460:0:14325:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2034a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2034ab expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136042.828505:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616434176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787136042.828531:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.830093:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98435f0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787136042.836724:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616434176 00000100:00100000:1.0:1787136042.836747:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616434176 00000100:00100000:1.0:1787136042.837006:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787136042.837019:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14325:x1873947616434176:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787136042.837857:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14325:x1873947616434176:12345-0@lo:501:mount.lustre.0 Request processed in 838us (9321us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136042.837868:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787136042.839286:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616434176:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787136042.839342:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616434304:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787136042.839402:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.839437:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98435f0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787136042.839470:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616434304 00000100:00100000:2.0:1787136042.839475:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616434304 00000100:00100000:2.0:1787136042.841860:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787136042.841874:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14325:x1873947616434304:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787136042.842112:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14325:x1873947616434304:12345-0@lo:503:mount.lustre.0 Request processed in 241us (2709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136042.842120:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787136042.842191:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616434304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787136042.842641:0:14374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:247d1cf6-e699-400d-82b2-f0faea63f3e6:14374:1873947616434432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787136042.842686:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136042.842735:0:14374:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f6c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787136042.842773:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616434432 00000100:00100000:2.0:1787136042.842785:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616434432 00000100:00100000:2.0:1787136042.842813:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787136042.842819:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14374:x1873947616434432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787136042.843016:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14374:x1873947616434432:12345-0@lo:502:llog_process_th.0 Request processed in 196us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136042.843023:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787136042.843128:0:14374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:247d1cf6-e699-400d-82b2-f0faea63f3e6:14374:1873947616434432:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1787136042.843180:0:14374:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787136042.843195:0:14374:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e987c3fb380) 00000020:00000080:0.0:1787136042.843212:0:14374:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1787136042.843352:0:14374:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e9876a4d800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787136042.843356:0:14374:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e9876a4d800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787136042.843359:0:14374:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e9876a4d800 4 00010000:00080000:0.0:1787136042.843383:0:14374:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8e9845649000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1787136042.844988:0:14374:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1787136042.845121:0:14374:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1787136042.845155:0:14374:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787136042.845166:0:14374:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf5850c552f2034b9 00000100:00080000:0.0:1787136042.845179:0:14374:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787136042.845185:0:14374:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e9845649000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1787136042.845218:0:14374:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e98746b8700 x1873947616434560/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787136042.845264:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873947616434560:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787136042.845326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787136042.845385:0:14374:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787136042.849759:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616434560 00000100:00100000:3.0:1787136042.849775:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616434560 00000100:00100000:3.0:1787136042.849819:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787136042.849827:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1873947616434560:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787136042.849922:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3299:x1873947616434560:12345-0@lo:38:llog_process_th.0 Request processed in 93us (4595us total) trans 0 rc -11/-11 00000100:00100000:3.0:1787136042.849936:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787136042.849994:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787136042.850003:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e9845649000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787136042.850009:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1787136042.850012:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873947616434560:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787136042.858654:0:14374:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:247d1cf6-e699-400d-82b2-f0faea63f3e6:14374:1873947616434688:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787136042.858761:0:14374:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136042.858807:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616434688 00000100:00100000:0.0:1787136042.858813:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616434688 00000100:00100000:0.0:1787136042.858853:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787136042.858862:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14374:x1873947616434688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787136042.859547:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14374:x1873947616434688:12345-0@lo:502:llog_process_th.0 Request processed in 683us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136042.859557:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787136042.859605:0:14374:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f6c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787136042.859629:0:14374:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:247d1cf6-e699-400d-82b2-f0faea63f3e6:14374:1873947616434688:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787136042.859657:0:14374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787136042.866926:0:14325:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787136042.866962:0:14325:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787136042.866992:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2034a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2034ab expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.867005:0:14325:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98413cae00/0xf5850c552f2034a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2034ab expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787136042.867079:0:14325:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787136042.867082:0:14325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787136042.867083:0:14325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787136042.867085:0:14325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787136042.867086:0:14325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787136042.867087:0:14325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787136042.867089:0:14325:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787136042.867090:0:14325:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787136042.867092:0:14325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787136042.867093:0:14325:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787136042.867097:0:14325:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787136042.867100:0:14325:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787136042.867101:0:14325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787136042.867102:0:14325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787136042.867103:0:14325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787136042.867105:0:14325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787136042.867106:0:14325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787136042.867107:0:14325:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787136042.867108:0:14325:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787136042.867109:0:14325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787136042.867117:0:14325:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787136042.867144:0:14325:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787136042.867164:0:14325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616434816:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787136042.867233:0:14325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.867268:0:14325:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9853369cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787136042.867523:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616434816 00000100:00100000:2.0:1787136042.867530:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616434816 00000100:00100000:2.0:1787136042.867574:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787136042.867583:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14325:x1873947616434816:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787136042.867627:0:14337:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787136042.867641:0:14337:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787136042.944818:0:14337:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787136042.946590:0:14337:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787136042.948701:0:14359:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787136042.948710:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787136042.956576:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.956602:0:14359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9874896400/0xf5850c552f20348f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203488 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.956610:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.956664:0:14359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9874896400/0xf5850c552f20348f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f203488 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.956678:0:14359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e9874896400/0xf5850c552f20348f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f203488 expref: 12 pid: 14338 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136042.956692:0:14359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14359:1873947616434944:0@lo:104: 00000100:00100000:2.0:1787136042.956766:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.956810:0:14359:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e987c73e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787136042.956858:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616434944 00000100:00100000:2.0:1787136042.956865:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616434944 00000100:00100000:2.0:1787136042.956907:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787136042.956915:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:247d1cf6-e699-400d-82b2-f0faea63f3e6+3:14359:x1873947616434944:12345-0@lo:104: 00010000:00010000:2.0:1787136042.956928:0:14326:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20348f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.956976:0:14326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787136042.956982:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:247d1cf6-e699-400d-82b2-f0faea63f3e6+3:14359:x1873947616434944:12345-0@lo:104: Request processed in 68us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136042.956989:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787136042.957012:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136042.957018:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20348f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.957025:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2400 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787136042.957028:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f20348f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.957037:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f20348f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787136042.957044:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f20348f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787136042.957070:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787136042.957102:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20348f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.957109:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787136042.957131:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20348f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.957139:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98820e2400/0xf5850c552f203488 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20348f expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.957156:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136042.957158:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136042.957160:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787136042.957183:0:14359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14359:1873947616434944:0@lo:104: 00010000:00010000:2.0:1787136042.957201:0:14359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136042.960924:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:247d1cf6-e699-400d-82b2-f0faea63f3e6:3302:1873947616435072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787136042.960996:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136042.961270:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616435072 00000100:00100000:2.0:1787136042.961278:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616435072 00010000:00010000:2.0:1787136042.961310:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9874896400/0xf5850c552f20348f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f203488 expref: 13 pid: 14338 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136042.961344:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787136042.961353:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:247d1cf6-e699-400d-82b2-f0faea63f3e6+13:3302:x1873947616435072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787136042.961367:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787136042.961373:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9874896400/0xf5850c552f20348f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f203488 expref: 13 pid: 14338 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961385:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9874896400/0xf5850c552f20348f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f203488 expref: 13 pid: 14338 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961403:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9874896400/0xf5850c552f20348f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f203488 expref: 13 pid: 14338 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961428:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961451:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787136042.961466:0:14328:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012757268s 00010000:00010000:2.0:1787136042.961471:0:14328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961478:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961485:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961493:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961499:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413ca200 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136042.961503:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961511:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961526:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961537:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787136042.961574:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:3302:x1873947616435072:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136042.961582:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787136042.961615:0:14359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961624:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136042.961630:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98413ca200/0xf5850c552f2034c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136042.961778:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:247d1cf6-e699-400d-82b2-f0faea63f3e6:3302:1873947616435072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787136042.977790:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14325:x1873947616434816:12345-0@lo:253:mount.lustre.0 Request processed in 110199us (110548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136042.977822:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787136042.977942:0:14325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:14325:1873947616434816:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787136042.977958:0:14325:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787136042.977961:0:14325:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787136042.977963:0:14325:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787136042.977964:0:14325:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787136042.977966:0:14325:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787136042.977967:0:14325:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787136042.977968:0:14325:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787136042.977970:0:14325:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787136042.977971:0:14325:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787136042.977973:0:14325:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787136042.977974:0:14325:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787136042.977989:0:14325:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787136042.982857:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787136042.983024:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787136042.983334:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787136042.983489:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787136042.983770:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1787136042.983929:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787136042.985635:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787136042.985858:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787136042.986217:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787136042.986516:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787136042.986797:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787136042.986953:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787136043.018710:0:14325:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787136043.023973:0:14325:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787136043.024185:0:14382:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1787136043.024190:0:14382:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1787136043.024750:0:14383:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1787136043.024865:0:14383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787136043.036936:0:14383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787136043.037006:0:14383:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787136043.037017:0:14383:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1787136043.038367:0:14325:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787136043.038585:0:14325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787136043.039976:0:14325:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787136043.039991:0:14325:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787136043.040932:0:14325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787136043.042388:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787136043.047280:0:14325:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787136043.047345:0:14325:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1787136043.054663:0:14325:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 0, last_idx 1 00080000:10000000:0.0:1787136043.056243:0:14325:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1787136043.077764:0:14325:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1787136043.116984:0:14325:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787136043.117021:0:14325:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f5d81c3b988 00100000:10000000:1.0:1787136043.117028:0:14325:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787136043.119675:0:14325:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787136043.119700:0:14325:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787136043.119714:0:14325:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787136043.119748:0:14325:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787136043.610312:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787136043.864373:0:14377:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787136043.864381:0:14377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787136043.864983:0:14377:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1787136043.864992:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 10000000:01000000:0.0:1787136044.440415:0:14340:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787136044.440422:0:14340:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e9876a4d800 from 6 10000000:01000000:0.0:1787136044.440427:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787136044.440473:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136044.440497:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136044.440508:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136044.440534:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616435200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787136044.440944:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136044.441114:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616435200 00000100:00100000:1.0:1787136044.441123:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616435200 00000100:00100000:1.0:1787136044.441188:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787136044.441198:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14340:x1873947616435200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787136044.441212:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1787136044.441233:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2f00 going to sleep for 11 seconds 00010000:00010000:1.0:1787136044.441242:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98533aee00/0xf5850c552f2034ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2034c7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136044.441268:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98533aee00/0xf5850c552f2034ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2034c7 expref: 12 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136044.441279:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98533aee00/0xf5850c552f2034ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2034c7 expref: 12 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136044.441289:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533aee00, rc 0) 00000100:00100000:1.0:1787136044.441345:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14340:x1873947616435200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136044.441353:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787136044.441899:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746ba300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616435200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787136044.441917:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2034ce expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136044.441926:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2034ce expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136044.441985:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616435328:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787136044.442022:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136044.442091:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad540 going to sleep for 11 seconds 00000100:00100000:1.0:1787136044.442419:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616435328 00000100:00100000:1.0:1787136044.442425:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616435328 00000100:00100000:1.0:1787136044.442452:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787136044.442460:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14340:x1873947616435328:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787136044.442476:0:14337:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787136044.442489:0:14337:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787136044.442492:0:14337:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1787136044.442679:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14340:x1873947616435328:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 219us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136044.442697:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787136044.443539:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616435328:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787136044.443587:0:14340:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787136044.443596:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2034ce expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136044.443607:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2034ce expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136044.634734:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787136044.889926:0:14377:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787136044.889935:0:14377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787136044.893849:0:14377:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787136044.893942:0:14377:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787136044.893984:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 1 count 1 00010000:00010000:0.0:1787136045.656872:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136046.685787:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136047.704644:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787136047.762473:0:14626:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:2.0:1787136048.088317:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787136048.088324:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787136048.088340:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787136048.088343:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787136048.088346:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787136048.088349:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787136048.088353:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e9845649000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787136048.088365:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e9845649000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1787136048.088388:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9876bd1500 x1873947616435584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787136048.088421:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787136048.088446:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:247d1cf6-e699-400d-82b2-f0faea63f3e6:3302:1873947616435456:0@lo:400:kworker.0 00000100:00100000:3.0:1787136048.088511:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136048.088570:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873947616435584:0@lo:38:kworker.0 00000100:00100000:3.0:1787136048.088597:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136048.088688:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616435456 00000100:00100000:0.0:1787136048.088710:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616435456 00000100:00100000:0.0:1787136048.088763:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787136048.088771:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:3302:x1873947616435456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787136048.088823:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:3302:x1873947616435456:12345-0@lo:400:kworker.0 Request processed in 52us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136048.088830:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787136048.088961:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616435584 00000100:00100000:2.0:1787136048.088965:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616435584 00000100:00100000:2.0:1787136048.088996:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787136048.089001:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1873947616435584:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1787136048.089022:0:14345:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 408 last 0 00000020:00000080:2.0:1787136048.089078:0:14345:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf5850c552f2034d5 00000004:00100000:2.0:1787136048.089092:0:14345:0:(mdt_handler.c:7490:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787136048.089269:0:14345:0:(import.c:65:import_set_state_nolock()) ffff8e98456a1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787136048.091796:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3299:x1873947616435584:12345-0@lo:38:kworker.0 Request processed in 2783us (3187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136048.091809:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787136048.092380:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:247d1cf6-e699-400d-82b2-f0faea63f3e6:3302:1873947616435456:0@lo:400:kworker.0 00010000:00080000:0.0:1787136048.094776:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e9876bd1500 x1873947616435584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787136058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787136048.094795:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787136048.094802:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787136048.094808:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787136048.094810:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e9845649000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787136048.094818:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3299:1873947616435584:0@lo:38:kworker.0 00010000:00010000:1.0:1787136048.728870:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136049.754845:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787136050.487749:0:14776:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1c71b090 20000000:00000080:1.0:1787136050.487769:0:14776:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e9845391000 uarg=0000000000000000 20000000:01000000:1.0:1787136050.487806:0:14776:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1787136050.487814:0:14776:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1787136050.487819:0:14776:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787136050.489899:0:14777:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1787136050.493619:0:14776:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787136050.508870:0:14776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1787136050.509928:0:14776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136050.510041:0:14776:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98820e3400/0xf5850c552f20349d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203496 expref: 11 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136050.510484:0:14776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136050.510589:0:14776:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98820e3400/0xf5850c552f20349d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f203496 expref: 11 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136050.510606:0:14776:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e98820e3400/0xf5850c552f20349d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f203496 expref: 11 pid: 14337 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136050.510621:0:14776:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14776:1873947616435712:0@lo:104: 00000100:00100000:0.0:1787136050.510710:0:14776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136050.510796:0:14776:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9746146180 going to sleep for 11 seconds 00000100:00100000:2.0:1787136050.510860:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616435712 00000100:00100000:2.0:1787136050.510868:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616435712 00000100:00100000:2.0:1787136050.510958:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787136050.510968:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:247d1cf6-e699-400d-82b2-f0faea63f3e6+3:14776:x1873947616435712:12345-0@lo:104: 00010000:00010000:2.0:1787136050.510981:0:14327:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20349d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136050.511077:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787136050.511084:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:247d1cf6-e699-400d-82b2-f0faea63f3e6+3:14776:x1873947616435712:12345-0@lo:104: Request processed in 118us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136050.511091:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787136050.511144:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787136050.511292:0:14776:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14776:1873947616435712:0@lo:104: 00010000:00010000:3.0:1787136050.511312:0:14776:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136050.511382:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20349d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136050.511390:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cb600 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:1.0:1787136050.511394:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f20349d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136050.511402:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f20349d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787136050.511408:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f20349d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787136050.511414:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787136050.511457:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20349d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136050.511464:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787136050.511485:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20349d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136050.511502:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98413cb600/0xf5850c552f203496 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20349d expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136050.511519:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136050.511521:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136050.511523:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787136050.511543:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787136050.511552:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:247d1cf6-e699-400d-82b2-f0faea63f3e6:3301:1873947616435840:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787136050.511582:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136050.511746:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616435840 00000100:00100000:3.0:1787136050.511751:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616435840 00010000:00010000:3.0:1787136050.511769:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98820e3400/0xf5850c552f20349d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f203496 expref: 12 pid: 14337 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136050.511801:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787136050.511809:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:3301:x1873947616435840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787136050.511819:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787136050.511824:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98820e3400/0xf5850c552f20349d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f203496 expref: 12 pid: 14337 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.511833:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98820e3400/0xf5850c552f20349d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f203496 expref: 12 pid: 14337 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.511846:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98820e3400/0xf5850c552f20349d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f203496 expref: 12 pid: 14337 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.511860:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.511869:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.511881:0:14328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.511888:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.511894:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.511906:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.511913:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136050.511916:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.511924:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.511942:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.511951:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787136050.511981:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:3301:x1873947616435840:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136050.511988:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787136050.512013:0:14776:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.512020:0:14776:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136050.512025:0:14776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9874897600/0xf5850c552f2034dc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136050.513281:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:247d1cf6-e699-400d-82b2-f0faea63f3e6:3301:1873947616435840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787136050.776287:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136051.800585:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787136052.056173:0:14340:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787136052.056183:0:14340:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e9876a4d800 from 10 10000000:01000000:3.0:1787136052.056189:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787136052.056272:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136052.056283:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136052.056294:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136052.056320:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616435968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787136052.056390:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136052.056453:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f6c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787136052.056573:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616435968 00000100:00100000:1.0:1787136052.056580:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616435968 00000100:00100000:1.0:1787136052.056634:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787136052.056644:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+11:14340:x1873947616435968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787136052.056657:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136052.056680:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98533af800/0xf5850c552f2034ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2034e3 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136052.056703:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98533af800/0xf5850c552f2034ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2034e3 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136052.056713:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98533af800/0xf5850c552f2034ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2034e3 expref: 12 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136052.056730:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533af800, rc 0) 00000100:00100000:1.0:1787136052.056777:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14340:x1873947616435968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136052.056784:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787136052.056937:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616435968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787136052.056952:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2034ea expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136052.056960:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2034ea expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136052.057012:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616436096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787136052.057037:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136052.057082:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f6c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787136052.057138:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616436096 00000100:00100000:1.0:1787136052.057142:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616436096 00000100:00100000:1.0:1787136052.057173:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787136052.057179:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14340:x1873947616436096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787136052.057418:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14340:x1873947616436096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136052.057655:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787136052.057878:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616436096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787136052.057912:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616436224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787136052.057954:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136052.057979:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9881f6c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787136052.058029:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616436224 00000100:00100000:1.0:1787136052.058034:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616436224 00000100:00100000:1.0:1787136052.058123:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787136052.058131:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14340:x1873947616436224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787136052.058284:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:14340:x1873947616436224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136052.058291:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787136052.058360:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616436224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787136052.059334:0:14837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787136052.061617:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787136052.061671:0:14340:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787136052.061686:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2034ea expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136052.061699:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2034ea expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136052.184163:0:3299:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787136042/real 1787136042] req@ffff8e9876bd2d80 x1873947616432896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787136052 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787136052.184199:0:3299:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e9876bd2d80 x1873947616432896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787136052 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787136052.184210:0:3299:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787136042/real 1787136042] req@ffff8e9876bd1c00 x1873947616432768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787136052 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787136052.184221:0:3299:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e9876bd1c00 x1873947616432768/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787136052 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787136052.184238:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e98496a4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787136052.184264:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787136052.184268:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616432896:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787136052.184274:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e9865ef9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787136052.184280:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787136052.184283:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616432768:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787136052.185655:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787136052.185669:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787136052.185673:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e9865ef9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787136052.185679:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 402 00000100:00080000:1.0:1787136052.185685:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787136052.185692:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e9865ef9800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1787136052.185712:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9881fa7b80 x1873947616436480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787136052.185746:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787136052.185750:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787136052.185751:0:8:0:(import.c:65:import_set_state_nolock()) ffff8e98496a4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787136052.185755:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 402 00000100:00080000:1.0:1787136052.185757:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1787136052.185761:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e98496a4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:1.0:1787136052.185773:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9881fa5180 x1873947616436608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787136052.185906:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:247d1cf6-e699-400d-82b2-f0faea63f3e6:3301:1873947616436352:0@lo:400:kworker.0 00000100:00100000:2.0:1787136052.185977:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136052.186225:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616436736:0@lo:400:kworker.0 00000100:00100000:3.0:1787136052.186261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136052.186362:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616436736 00000100:00100000:2.0:1787136052.186379:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616436736 00000100:00100000:2.0:1787136052.186429:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787136052.186439:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616436736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136052.186494:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616436736:12345-0@lo:400:kworker.0 Request processed in 56us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136052.186502:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787136052.186542:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e9881fa7480 x1873947616436736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136068 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787136052.186555:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616436736:0@lo:400:kworker.0 00000100:00100000:0.0:1787136052.186745:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616436480:0@lo:8:kworker.0 00000400:00000100:0.0:1787136052.186773:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873947616436480 offset 0 length 520: 4 00000100:00100000:0.0:1787136052.186797:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616436608:0@lo:8:kworker.0 00000400:00000100:0.0:1787136052.186813:0:3299:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1873947616436608 offset 0 length 520: 4 00000100:00100000:1.0:1787136052.186988:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616436352 00000100:00100000:1.0:1787136052.186993:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616436352 00000100:00100000:1.0:1787136052.187030:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787136052.187038:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:3301:x1873947616436352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787136052.187109:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:3301:x1873947616436352:12345-0@lo:400:kworker.0 Request processed in 72us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136052.187116:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787136052.192917:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:247d1cf6-e699-400d-82b2-f0faea63f3e6:3301:1873947616436352:0@lo:400:kworker.0 00010000:00010000:3.0:1787136052.832632:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136053.850146:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787136054.109033:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787136054.874376:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787136055.786520:0:15026:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787136055.786524:0:15026:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787136055.786629:0:15026:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e984564f800 00000020:01000004:1.0:1787136055.786655:0:15026:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1787136055.786666:0:15026:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787136055.786693:0:15026:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e9876bc4d40) 00000020:00000080:1.0:1787136055.786712:0:15026:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787136055.818115:0:15026:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787136055.818393:0:15026:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787136055.819034:0:15026:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787136055.819294:0:15026:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787136055.819490:0:15026:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787136055.820246:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 561: rc = 0 00100000:10000000:0.0:1787136055.820385:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 561: rc = 0 00100000:10000000:0.0:1787136055.820485:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 561: rc = 0 00100000:10000000:0.0:1787136055.820990:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 306: rc = 0 00100000:10000000:0.0:1787136055.821293:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 306: rc = 0 00100000:10000000:0.0:1787136055.821539:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 306: rc = 0 00100000:10000000:0.0:1787136055.821788:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 306: rc = 0 00100000:10000000:0.0:1787136055.822030:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 306: rc = 0 00100000:10000000:0.0:1787136055.822298:0:15026:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 306: rc = 0 00000020:00000080:0.0:1787136055.822862:0:15026:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787136055.822873:0:15026:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787136055.822884:0:15026:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf5850c552f2034f8 00000020:01000004:0.0:1787136055.822891:0:15026:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787136055.822911:0:15026:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787136055.822915:0:15026:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787136055.822921:0:15026:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787136055.822925:0:15026:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787136055.822937:0:15026:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e987c3f99c0) 00000020:00000080:0.0:1787136055.822948:0:15026:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1787136055.826465:0:15026:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787136055.826684:0:15026:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787136055.826691:0:15026:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787136055.844658:0:15026:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787136055.844675:0:15026:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787136055.845279:0:15026:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787136055.845288:0:15026:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787136055.846888:0:15026:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787136055.848303:0:15026:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787136055.848312:0:15026:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1787136055.849354:0:15026:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1787136055.849364:0:15026:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787136055.873135:0:15026:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787136055.873371:0:15026:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787136055.873378:0:15026:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787136055.874565:0:15026:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787136055.874575:0:15026:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787136055.875262:0:15026:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787136055.875269:0:15026:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787136055.876842:0:15026:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787136055.877039:0:15026:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787136055.877044:0:15026:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1787136055.877701:0:15026:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1787136055.877710:0:15026:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1787136055.896176:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787136055.918632:0:15026:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787136055.921747:0:15026:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787136055.921755:0:15026:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787136055.922912:0:15026:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787136055.922922:0:15026:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787136055.924493:0:15026:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787136055.924522:0:15026:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787136055.924529:0:15026:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787136055.945742:0:15026:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787136055.945789:0:15026:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.138@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1787136055.945793:0:15026:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787136055.945795:0:15026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787136055.945796:0:15026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787136055.945797:0:15026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787136055.945798:0:15026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787136055.945799:0:15026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787136055.945801:0:15026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787136055.945803:0:15026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787136055.945804:0:15026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787136055.945807:0:15026:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1787136055.945809:0:15026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787136055.945811:0:15026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787136055.945812:0:15026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787136055.945813:0:15026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787136055.945814:0:15026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787136055.945815:0:15026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787136055.945816:0:15026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787136055.945817:0:15026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787136055.945818:0:15026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787136055.945845:0:15026:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787136055.945864:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616436864:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787136055.945930:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136055.947240:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98748999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787136055.950781:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616436864 00000100:00100000:1.0:1787136055.950798:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616436864 00000100:00100000:1.0:1787136055.950867:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787136055.950878:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:15026:x1873947616436864:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787136055.950917:0:14337:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787136055.950921:0:14337:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787136055.950925:0:14337:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787136055.963976:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:15026:x1873947616436864:12345-0@lo:253:mount.lustre.0 Request processed in 13091us (18035us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136055.964165:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616436864:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787136055.964185:0:15026:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787136055.964189:0:15026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787136055.964190:0:15026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787136055.964192:0:15026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787136055.964193:0:15026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787136055.964194:0:15026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787136055.964195:0:15026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787136055.964197:0:15026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787136055.964199:0:15026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787136055.964200:0:15026:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787136055.964223:0:15026:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e984564f800 from lustre-OST0000 10000000:01000000:0.0:1787136055.964256:0:15026:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787136055.964260:0:15026:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787136055.964266:0:15026:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e98434699c0 local copy 00010000:00010000:0.0:1787136055.964277:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2033f5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136055.964517:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616436992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787136055.964556:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136055.964651:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e97461469c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787136055.967149:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787136055.967210:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616436992 00000100:00100000:2.0:1787136055.967218:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616436992 00000100:00100000:1.0:1787136055.968237:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787136055.968254:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:15026:x1873947616436992:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787136055.968555:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:15026:x1873947616436992:12345-0@lo:501:mount.lustre.0 Request processed in 306us (3997us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787136055.968562:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787136055.968748:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616436992:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787136055.968769:0:15026:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787136055.968948:0:15026:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787136055.968958:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2033f5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136055.968968:0:15026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2033f5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787136055.969025:0:15026:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e984564f800 10000000:01000000:0.0:1787136055.969031:0:15026:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787136055.969036:0:15026:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e98434699c0 10000000:01000000:0.0:1787136055.969038:0:15026:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1787136055.969041:0:15026:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff8e98434699c0 from 1 10000000:01000000:0.0:1787136055.969044:0:15026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1787136055.969571:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874897c00/0xf5850c552f203506 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136055.969582:0:15026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9874897c00/0xf5850c552f203506 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136055.969592:0:15026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9874897c00/0xf5850c552f203506 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136055.969614:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787136055.969672:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136055.969717:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e97461469c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787136055.969804:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616437120 00000100:00100000:3.0:1787136055.969812:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616437120 00000100:00100000:3.0:1787136055.969861:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787136055.969869:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+12:15026:x1873947616437120:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787136055.969882:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136055.969895:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98820e3400/0xf5850c552f20350d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f203506 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136055.969916:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98820e3400/0xf5850c552f20350d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f203506 expref: 13 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136055.969926:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98820e3400/0xf5850c552f20350d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203506 expref: 13 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136055.969935:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e3400, rc 0) 00000100:00100000:3.0:1787136055.969978:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+13:15026:x1873947616437120:12345-0@lo:101:mount.lustre.0 Request processed in 110us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136055.969995:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787136055.970440:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787136055.970456:0:15026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9874897c00/0xf5850c552f203506 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20350d expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136055.970465:0:15026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9874897c00/0xf5850c552f203506 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20350d expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787136055.970483:0:15026:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1787136055.970501:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874897c00/0xf5850c552f203506 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20350d expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136055.970520:0:15026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9874897c00/0xf5850c552f203506 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20350d expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787136055.970528:0:15026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787136055.970532:0:15026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787136055.970537:0:15026:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1787136055.970539:0:15026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787136055.970557:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874896400/0xf5850c552f203514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136055.970563:0:15026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9874896400/0xf5850c552f203514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136055.970571:0:15026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9874896400/0xf5850c552f203514 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136055.970583:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787136055.970609:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136055.970629:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e97461469c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787136055.970860:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616437248 00000100:00100000:3.0:1787136055.970865:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616437248 00000100:00100000:3.0:1787136055.970890:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787136055.970896:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+13:15026:x1873947616437248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787136055.970906:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136055.970915:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98820e3800/0xf5850c552f20351b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f203514 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136055.970931:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98820e3800/0xf5850c552f20351b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f203514 expref: 14 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136055.970940:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98820e3800/0xf5850c552f20351b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203514 expref: 14 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136055.970960:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e3800, rc 0) 00000100:00100000:3.0:1787136055.971008:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+14:15026:x1873947616437248:12345-0@lo:101:mount.lustre.0 Request processed in 112us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136055.971014:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787136055.971702:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437248:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787136055.971718:0:15026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9874896400/0xf5850c552f203514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20351b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136055.971728:0:15026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9874896400/0xf5850c552f203514 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20351b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787136055.973931:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787136055.978007:0:15026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787136055.978459:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787136055.978504:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787136055.978535:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787136055.978591:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787136055.978631:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1787136055.978682:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1787136055.978750:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1787136055.978759:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1787136055.978845:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787136055.978909:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136055.978946:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9746146900 going to sleep for 11 seconds 00000100:00100000:1.0:1787136055.979233:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616437376 00000100:00100000:1.0:1787136055.979241:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616437376 00000100:00100000:1.0:1787136055.979300:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787136055.979310:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+14:15026:x1873947616437376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787136055.979704:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+14:15026:x1873947616437376:12345-0@lo:501:mount.lustre.0 Request processed in 394us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136055.979712:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787136055.980312:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787136055.980367:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787136055.980411:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136055.980442:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9746146900 going to sleep for 11 seconds 00000100:00100000:3.0:1787136055.980939:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616437504 00000100:00100000:3.0:1787136055.980946:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616437504 00000100:00100000:3.0:1787136055.980997:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787136055.981005:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+14:15026:x1873947616437504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787136055.981359:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+14:15026:x1873947616437504:12345-0@lo:503:mount.lustre.0 Request processed in 354us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136055.981366:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787136055.981655:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437504:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787136055.982421:0:15026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787136055.982505:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787136055.982558:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136055.982599:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9746146900 going to sleep for 11 seconds 00000100:00100000:3.0:1787136055.982787:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616437632 00000100:00100000:3.0:1787136055.982797:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616437632 00000100:00100000:3.0:1787136055.982839:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787136055.982848:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+14:15026:x1873947616437632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787136055.983188:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787136055.983466:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787136055.983520:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787136055.983552:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787136055.983600:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787136055.983661:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787136055.983697:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787136055.983746:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787136055.983781:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787136055.983816:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787136055.983881:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787136055.983920:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787136055.983969:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787136055.984003:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787136055.984216:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136055.984256:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787136055.984480:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616437760 00000100:00100000:2.0:1787136055.984487:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616437760 00000100:00100000:2.0:1787136055.984519:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787136055.984528:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616437760:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787136055.984702:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616437760:12345-0@lo:502:mount.lustre.0 Request processed in 174us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136055.984710:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787136055.984791:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+14:15026:x1873947616437632:12345-0@lo:502:mount.lustre.0 Request processed in 1943us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136055.984798:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787136055.984887:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787136055.984954:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787136055.984965:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787136055.986427:0:15040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787136055.986438:0:15040:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787136055.986444:0:15040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136055.986447:0:15040:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787136055.986452:0:15040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787136055.986467:0:15040:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e98607619c0) 00000020:00000080:0.0:1787136055.986489:0:15040:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787136055.986497:0:15040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787136055.986578:0:15040:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e984564f800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787136055.986585:0:15040:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787136055.986592:0:15040:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf5850c552f203529 00010000:00010000:0.0:1787136055.994625:0:15040:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787136055.995030:0:15040:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1787136055.996383:0:15040:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787136056.011588:0:15040:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787136056.011600:0:15040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787136056.011606:0:15040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136056.011608:0:15040:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787136056.011611:0:15040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787136056.011614:0:15040:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1787136056.011615:0:15040:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787136056.011617:0:15040:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787136056.011619:0:15040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787136056.011621:0:15040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136056.011622:0:15040:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787136056.011624:0:15040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787136056.011627:0:15040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136056.011628:0:15040:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787136056.011631:0:15040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787136056.011632:0:15040:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787136056.011645:0:15040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787136056.011648:0:15040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136056.011649:0:15040:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787136056.011652:0:15040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787136056.011654:0:15040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136056.011655:0:15040:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787136056.011658:0:15040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787136056.011714:0:15040:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787136056.011717:0:15040:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787136056.011718:0:15040:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787136056.011721:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787136056.023710:0:15026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787136056.023764:0:15026:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787136056.023789:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874896400/0xf5850c552f203514 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20351b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136056.023803:0:15026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9874896400/0xf5850c552f203514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20351b expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787136056.023812:0:15026:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e984564f800 from 1 10000000:01000000:1.0:1787136056.023815:0:15026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787136056.023854:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136056.023861:0:15026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136056.023889:0:15026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136056.023914:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437888:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787136056.023978:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136056.024516:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787136056.024574:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616437888 00000100:00100000:3.0:1787136056.024582:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616437888 00000100:00100000:3.0:1787136056.024647:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787136056.024658:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+14:15026:x1873947616437888:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787136056.024673:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136056.024688:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98820e3a00/0xf5850c552f203537 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f203530 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136056.024729:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98820e3a00/0xf5850c552f203537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f203530 expref: 15 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136056.024739:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98820e3a00/0xf5850c552f203537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203530 expref: 15 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136056.024748:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98820e3a00, rc 0) 00000100:00100000:3.0:1787136056.024800:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616437888:12345-0@lo:101:mount.lustre.0 Request processed in 144us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136056.024807:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787136056.026340:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616437888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787136056.026365:0:15026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203537 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136056.026377:0:15026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f203537 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787136056.028763:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787136056.029398:0:15026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787136056.029652:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787136056.029701:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787136056.030835:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787136056.030853:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787136056.030953:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787136056.031525:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136056.031568:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787136056.031678:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616438016 00000100:00100000:0.0:1787136056.031695:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616438016 00000100:00100000:0.0:1787136056.031745:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787136056.031754:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616438016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787136056.032015:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616438016:12345-0@lo:501:mount.lustre.0 Request processed in 261us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136056.032022:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787136056.032276:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787136056.032315:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787136056.033475:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136056.033518:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616438144 00000100:00100000:1.0:1787136056.033533:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616438144 00000100:00100000:1.0:1787136056.033572:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787136056.033581:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616438144:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787136056.033759:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616438144:12345-0@lo:503:mount.lustre.0 Request processed in 179us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136056.033766:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787136056.033815:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787136056.033834:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438144:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787136056.039459:0:15026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787136056.039556:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438272:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787136056.039648:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136056.039692:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787136056.040466:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616438272 00000100:00100000:0.0:1787136056.040476:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616438272 00000100:00100000:0.0:1787136056.040517:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787136056.040526:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616438272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787136056.040745:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616438272:12345-0@lo:502:mount.lustre.0 Request processed in 218us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136056.040753:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787136056.041219:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438272:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787136056.043867:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787136056.043966:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787136056.044287:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787136056.044320:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787136056.045263:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787136056.045319:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787136056.046203:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787136056.046247:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787136056.046303:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787136056.046569:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136056.046616:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984d5f5cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787136056.047182:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616438400 00000100:00100000:3.0:1787136056.047189:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616438400 00000100:00100000:3.0:1787136056.047239:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787136056.047248:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616438400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787136056.047463:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616438400:12345-0@lo:502:mount.lustre.0 Request processed in 215us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136056.047470:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787136056.047629:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787136056.047764:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787136056.047777:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787136056.049877:0:15044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787136056.049888:0:15044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787136056.049890:0:15044:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787136056.049898:0:15044:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e984564f800 00000020:00000080:1.0:1787136056.049900:0:15044:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787136056.049907:0:15044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787136056.049909:0:15044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787136056.049910:0:15044:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787136056.049912:0:15044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787136056.049914:0:15044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787136056.049916:0:15044:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787136056.049919:0:15044:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e984564f800 00000020:00000080:1.0:1787136056.049920:0:15044:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787136056.049985:0:15044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787136056.049990:0:15044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787136056.049991:0:15044:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787136056.049994:0:15044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787136056.049996:0:15044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787136056.049998:0:15044:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787136056.050002:0:15044:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e984564f800 00000020:00000080:1.0:1787136056.050004:0:15044:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787136056.050037:0:15044:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787136056.050040:0:15044:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787136056.050041:0:15044:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787136056.050209:0:15044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787136056.050372:0:15026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787136056.050403:0:15026:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787136056.050425:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203537 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.050436:0:15026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203537 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787136056.050475:0:15026:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787136056.050478:0:15026:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e984564f800 10000000:01000000:0.0:1787136056.050481:0:15026:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e984564f800 10000000:01000000:0.0:1787136056.050485:0:15026:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787136056.050489:0:15026:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e984564f800 from 1 10000000:01000000:0.0:1787136056.050492:0:15026:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787136056.050525:0:15026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874897e00/0xf5850c552f20353e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.050542:0:15026:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9874897e00/0xf5850c552f20353e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.050554:0:15026:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9874897e00/0xf5850c552f20353e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136056.050577:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787136056.050649:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136056.050682:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9746146180 going to sleep for 11 seconds 00000100:00100000:1.0:1787136056.052289:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616438528 00000100:00100000:1.0:1787136056.052300:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616438528 00000100:00100000:1.0:1787136056.052365:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787136056.052375:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616438528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787136056.052391:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136056.052408:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98533aea00/0xf5850c552f203545 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20353e expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136056.052447:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98533aea00/0xf5850c552f203545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20353e expref: 16 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136056.052458:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98533aea00/0xf5850c552f203545 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20353e expref: 16 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136056.052467:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533aea00, rc 0) 00000100:00100000:1.0:1787136056.052530:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15026:x1873947616438528:12345-0@lo:101:mount.lustre.0 Request processed in 157us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136056.052537:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787136056.052600:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746ba300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787136056.052615:0:15026:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9874897e00/0xf5850c552f20353e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203545 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136056.052624:0:15026:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9874897e00/0xf5850c552f20353e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f203545 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787136056.053408:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787136056.053725:0:15026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787136056.053970:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787136056.064737:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787136056.064818:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787136056.064912:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787136056.064962:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787136056.065041:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787136056.065306:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787136056.065360:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787136056.065416:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787136056.065456:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787136056.065494:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787136056.065548:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787136056.065589:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787136056.065663:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787136056.065738:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787136056.065785:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787136056.065910:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787136056.066148:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787136056.066195:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787136056.066232:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787136056.066285:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787136056.066324:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787136056.066375:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787136056.066442:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787136056.066501:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787136056.066559:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787136056.066650:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787136056.066693:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787136056.066800:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787136056.066810:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787136056.066933:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787136056.067286:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136056.067389:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616438656 00000100:00100000:0.0:1787136056.067399:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616438656 00000100:00100000:0.0:1787136056.067447:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787136056.067456:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15026:x1873947616438656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787136056.067727:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15026:x1873947616438656:12345-0@lo:501:mount.lustre.0 Request processed in 270us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136056.067736:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787136056.067853:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9746146600 going to sleep for 11 seconds 00000100:00100000:0.0:1787136056.067878:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787136056.067916:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438784:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787136056.067954:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136056.068422:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616438784 00000100:00100000:0.0:1787136056.068428:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616438784 00000100:00100000:0.0:1787136056.068459:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787136056.068467:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15026:x1873947616438784:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787136056.069477:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15026:x1873947616438784:12345-0@lo:503:mount.lustre.0 Request processed in 1007us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136056.069498:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787136056.069572:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9746146600 going to sleep for 11 seconds 00000100:00100000:0.0:1787136056.069595:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438784:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787136056.071700:0:15026:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787136056.071865:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787136056.071942:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136056.072001:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9746146600 going to sleep for 11 seconds 00000100:00100000:1.0:1787136056.072228:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616438912 00000100:00100000:1.0:1787136056.072236:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616438912 00000100:00100000:1.0:1787136056.072285:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787136056.072295:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15026:x1873947616438912:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787136056.072584:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15026:x1873947616438912:12345-0@lo:502:mount.lustre.0 Request processed in 290us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136056.072592:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787136056.072850:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616438912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787136056.073470:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787136056.073678:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787136056.073722:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787136056.073780:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787136056.073902:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787136056.073952:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787136056.074217:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787136056.074267:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787136056.074627:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787136056.074686:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787136056.074731:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787136056.075320:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787136056.075612:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787136056.075661:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787136056.075729:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787136056.075769:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787136056.075905:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787136056.075955:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787136056.076000:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787136056.076032:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787136056.076134:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787136056.076170:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787136056.076205:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787136056.076256:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787136056.076295:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787136056.076344:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787136056.076398:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787136056.076455:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787136056.076492:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787136056.076692:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787136056.076728:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787136056.076758:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787136056.076920:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787136056.076972:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787136056.077006:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787136056.077156:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787136056.077196:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787136056.077229:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787136056.077275:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787136056.077311:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787136056.077564:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616439040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787136056.077663:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136056.077709:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9746146600 going to sleep for 11 seconds 00000100:00100000:1.0:1787136056.077927:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616439040 00000100:00100000:1.0:1787136056.077935:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616439040 00000100:00100000:1.0:1787136056.077996:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787136056.078007:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15026:x1873947616439040:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787136056.078414:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15026:x1873947616439040:12345-0@lo:502:mount.lustre.0 Request processed in 407us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136056.078423:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787136056.078489:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616439040:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787136056.078734:0:15026:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787136056.078749:0:15026:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787136056.084580:0:15049:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787136056.084597:0:15049:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e9860760000) 00000020:00000080:0.0:1787136056.084622:0:15049:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787136056.085907:0:15049:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e984564f800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787136056.085915:0:15049:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e984564f800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787136056.085918:0:15049:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e984564f800 3 00010000:00080000:0.0:1787136056.085966:0:15049:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8e974757f000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.138@tcp at head 00010000:00010000:0.0:1787136056.093797:0:15049:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787136056.095586:0:15049:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787136056.095630:0:15049:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787136056.095654:0:15049:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf5850c552f203553 00000100:00080000:0.0:1787136056.095665:0:15049:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787136056.095670:0:15049:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e974757f000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1787136056.095705:0:15049:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e98746b9f80 x1873947616439168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787136056.095756:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1873947616439168:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787136056.095832:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787136056.095893:0:15049:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787136056.095918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787136056.095922:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787136056.095925:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787136056.095928:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787136056.095965:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616439296:0@lo:400:kworker.0 00000100:00100000:0.0:1787136056.096001:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136056.097929:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616439168 00000100:00100000:2.0:1787136056.097942:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616439168 00000100:00100000:2.0:1787136056.098061:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616439296 00000100:00100000:2.0:1787136056.098137:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616439296 00000100:00100000:2.0:1787136056.098171:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787136056.098180:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616439296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136056.098262:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616439296:12345-0@lo:400:kworker.0 Request processed in 82us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136056.098269:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787136056.098286:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787136056.098291:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3299:x1873947616439168:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787136056.098312:0:14345:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 416 last 0 00000020:00000080:2.0:1787136056.098881:0:14345:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf5850c552f20355a 00000004:00100000:2.0:1787136056.098898:0:14345:0:(mdt_handler.c:7490:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787136056.098934:0:14345:0:(import.c:65:import_set_state_nolock()) ffff8e984758b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787136056.099736:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3299:x1873947616439168:12345-0@lo:38:llog_process_th.0 Request processed in 1439us (3899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136056.099745:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787136056.099831:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e98746bb100 x1873947616439296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787136056.099845:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616439296:0@lo:400:kworker.0 00000040:00080000:1.0:1787136056.107130:0:15049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787136056.107294:0:15026:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787136056.107322:0:15026:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787136056.107571:0:15026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874897e00/0xf5850c552f20353e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203545 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136056.107583:0:15026:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9874897e00/0xf5850c552f20353e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203545 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787136056.107654:0:15026:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787136056.107656:0:15026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787136056.107658:0:15026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787136056.107659:0:15026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787136056.107660:0:15026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787136056.107661:0:15026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787136056.107663:0:15026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787136056.107665:0:15026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787136056.107666:0:15026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787136056.107670:0:15026:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787136056.107672:0:15026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787136056.107673:0:15026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787136056.107675:0:15026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787136056.107676:0:15026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787136056.107677:0:15026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787136056.107678:0:15026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787136056.107679:0:15026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787136056.107680:0:15026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787136056.107681:0:15026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787136056.107705:0:15026:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787136056.107724:0:15026:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616439424:0@lo:253:mount.lustre.0 00010000:00080000:0.0:1787136056.108232:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e98746b9f80 x1873947616439168/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787136066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787136056.108244:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787136056.108252:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787136056.108260:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787136056.108264:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787136056.108268:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e974757f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787136056.108275:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3299:1873947616439168:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787136056.108594:0:15026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136056.108678:0:15026:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9853369180 going to sleep for 11 seconds 00000100:00100000:1.0:1787136056.110275:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616439424 00000100:00100000:1.0:1787136056.110287:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616439424 00000100:00100000:1.0:1787136056.110438:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787136056.110449:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15026:x1873947616439424:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787136056.110480:0:14337:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787136056.110505:0:14337:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787136056.151505:0:14337:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787136056.151524:0:14337:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787136056.151568:0:14359:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787136056.151574:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787136056.151595:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136056.151614:0:14359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98533aee00/0xf5850c552f2034ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2034c7 expref: 16 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136056.151623:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136056.151691:0:14359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98533aee00/0xf5850c552f2034ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f2034c7 expref: 16 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136056.151705:0:14359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e98533aee00/0xf5850c552f2034ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f2034c7 expref: 16 pid: 14335 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136056.151720:0:14359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14359:1873947616439552:0@lo:104: 00000100:00100000:2.0:1787136056.151781:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136056.151837:0:14359:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e986030ec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787136056.151857:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616439552 00000100:00100000:0.0:1787136056.151865:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616439552 00000100:00100000:0.0:1787136056.151915:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787136056.151923:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:247d1cf6-e699-400d-82b2-f0faea63f3e6+3:14359:x1873947616439552:12345-0@lo:104: 00010000:00010000:0.0:1787136056.151936:0:14326:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2034ce expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152002:0:14326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787136056.152008:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:247d1cf6-e699-400d-82b2-f0faea63f3e6+3:14359:x1873947616439552:12345-0@lo:104: Request processed in 86us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136056.152015:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1787136056.152038:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787136056.152083:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2034ce expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152091:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896200 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:0.0:1787136056.152095:0:14331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f2034ce expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152105:0:14331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f2034ce expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787136056.152111:0:14331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f2034ce expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787136056.152117:0:14331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787136056.152142:0:14331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2034ce expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152167:0:14331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787136056.152198:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2034ce expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152205:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e9874896200/0xf5850c552f2034c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2034ce expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152220:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136056.152222:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136056.152224:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787136056.152236:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:247d1cf6-e699-400d-82b2-f0faea63f3e6:3300:1873947616439680:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787136056.152264:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136056.152403:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616439680 00000100:00100000:0.0:1787136056.152409:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616439680 00010000:00010000:0.0:1787136056.152425:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98533aee00/0xf5850c552f2034ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2034c7 expref: 17 pid: 14335 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136056.152452:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787136056.152459:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:3300:x1873947616439680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787136056.152483:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787136056.152490:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98533aee00/0xf5850c552f2034ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2034c7 expref: 17 pid: 14335 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152501:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98533aee00/0xf5850c552f2034ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f2034c7 expref: 17 pid: 14335 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152518:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152527:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787136056.152551:0:14330:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012757268s 00010000:00010000:0.0:1787136056.152555:0:14330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152562:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152568:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152575:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152580:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787136056.152584:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152592:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152600:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136056.152609:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787136056.152656:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:3300:x1873947616439680:12345-0@lo:103:ldlm_bl.0 Request processed in 197us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136056.152665:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787136056.152687:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:247d1cf6-e699-400d-82b2-f0faea63f3e6:3300:1873947616439680:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787136056.152799:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98533aee00/0xf5850c552f2034ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f2034c7 expref: 16 pid: 14335 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136056.152809:0:14359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14359:1873947616439552:0@lo:104: 00010000:00010000:1.0:1787136056.152821:0:14359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136056.152830:0:14359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136056.152837:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136056.152850:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9876c9a400/0xf5850c552f203561 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136056.164376:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:15026:x1873947616439424:12345-0@lo:253:mount.lustre.0 Request processed in 53921us (56578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136056.164389:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787136056.164488:0:15026:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15026:1873947616439424:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787136056.164504:0:15026:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787136056.164507:0:15026:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787136056.164509:0:15026:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787136056.164510:0:15026:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787136056.164511:0:15026:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787136056.164512:0:15026:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787136056.164513:0:15026:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787136056.164514:0:15026:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787136056.164516:0:15026:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787136056.164517:0:15026:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787136056.164530:0:15026:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787136056.170751:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787136056.170943:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787136056.171486:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787136056.171669:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787136056.171904:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787136056.172425:0:15026:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787136056.173812:0:15026:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1787136056.243577:0:15026:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1787136056.243586:0:15026:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1787136056.243625:0:15026:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787136056.243696:0:15026:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787136056.243727:0:15026:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1787136056.243752:0:15026:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787136056.921178:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136057.945475:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787136058.200446:0:14340:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787136058.200454:0:14340:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e9876a4d800 from 7 10000000:01000000:1.0:1787136058.200458:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787136058.200505:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136058.200518:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136058.200529:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136058.200555:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616439808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787136058.201129:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136058.201208:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843397000 going to sleep for 11 seconds 00000100:00100000:2.0:1787136058.201393:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616439808 00000100:00100000:2.0:1787136058.201402:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616439808 00000100:00100000:2.0:1787136058.201455:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787136058.201465:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+15:14340:x1873947616439808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787136058.201497:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787136058.201514:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9876c9b200/0xf5850c552f20356f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f203568 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136058.201540:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9876c9b200/0xf5850c552f20356f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f203568 expref: 16 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136058.201550:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9876c9b200/0xf5850c552f20356f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203568 expref: 16 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136058.201559:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9876c9b200, rc 0) 00000100:00100000:2.0:1787136058.204839:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:14340:x1873947616439808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3366us (3702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136058.204852:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787136058.205915:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616439808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787136058.205959:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20356f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136058.205972:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20356f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136058.206163:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616439936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787136058.206226:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136058.206260:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457db900 going to sleep for 11 seconds 00000100:00100000:0.0:1787136058.207121:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616439936 00000100:00100000:0.0:1787136058.207131:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616439936 00000100:00100000:0.0:1787136058.207190:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787136058.207200:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:14340:x1873947616439936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787136058.207222:0:14337:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787136058.207242:0:14337:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787136058.207245:0:14337:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1787136058.207355:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:14340:x1873947616439936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136058.207364:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787136058.207945:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616439936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787136058.208012:0:14340:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787136058.208021:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20356f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136058.208034:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20356f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136058.968357:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136059.995366:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136061.020731:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787136061.401990:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787136061.401998:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787136061.402000:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787136061.402004:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787136061.402039:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787136061.402076:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:247d1cf6-e699-400d-82b2-f0faea63f3e6:3300:1873947616440064:0@lo:400:kworker.0 00000100:00100000:2.0:1787136061.402142:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136061.402205:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616440192:0@lo:400:kworker.0 00000100:00100000:3.0:1787136061.402220:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616440064 00000100:00100000:3.0:1787136061.402228:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616440064 00000100:00100000:2.0:1787136061.402232:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136061.402251:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787136061.402256:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616440320:0@lo:400:kworker.0 00000100:00100000:3.0:1787136061.402271:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787136061.402279:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:3300:x1873947616440064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136061.402290:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136061.402319:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616440192 00000100:00100000:2.0:1787136061.402323:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616440192 00000100:00100000:2.0:1787136061.402347:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616440320 00000100:00100000:2.0:1787136061.402349:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616440320 00000100:00100000:2.0:1787136061.402371:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787136061.402377:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616440192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136061.402421:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616440192:12345-0@lo:400:kworker.0 Request processed in 44us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136061.402429:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787136061.402435:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:3300:x1873947616440064:12345-0@lo:400:kworker.0 Request processed in 157us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136061.402441:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787136061.402444:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787136061.402449:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616440320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136061.402474:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616440320:12345-0@lo:400:kworker.0 Request processed in 25us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136061.402481:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787136061.402517:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9876bd1500 x1873947616440320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787136061.402530:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616440320:0@lo:400:kworker.0 00010000:00080000:2.0:1787136061.402540:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9876bd2d80 x1873947616440192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787136061.402548:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616440192:0@lo:400:kworker.0 00000100:00100000:2.0:1787136061.402576:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:247d1cf6-e699-400d-82b2-f0faea63f3e6:3300:1873947616440064:0@lo:400:kworker.0 00000100:00080000:1.0:1787136061.402800:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787136061.825559:0:15394:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787136062.042534:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136063.076683:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136064.088208:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787136064.344771:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787136065.114738:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136066.136142:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787136066.522515:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787136066.522522:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787136066.522525:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787136066.522528:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787136066.522583:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616440576:0@lo:400:kworker.0 00000100:00100000:1.0:1787136066.522673:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136066.522727:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787136066.522735:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:247d1cf6-e699-400d-82b2-f0faea63f3e6:3301:1873947616440448:0@lo:400:kworker.0 00000100:00100000:1.0:1787136066.522764:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136066.522796:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616440704:0@lo:400:kworker.0 00000100:00100000:1.0:1787136066.522835:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136066.522872:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616440576 00000100:00100000:1.0:1787136066.522879:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616440576 00000100:00100000:1.0:1787136066.522930:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616440704 00000100:00100000:1.0:1787136066.522933:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616440704 00000100:00100000:1.0:1787136066.522960:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787136066.522968:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616440576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787136066.523018:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616440576:12345-0@lo:400:kworker.0 Request processed in 49us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136066.523065:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787136066.523081:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787136066.523088:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616440704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787136066.523117:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616440704:12345-0@lo:400:kworker.0 Request processed in 30us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136066.523122:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787136066.523138:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616440448 00000100:00100000:1.0:1787136066.523141:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616440448 00000100:00100000:1.0:1787136066.523163:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787136066.523170:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:3301:x1873947616440448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787136066.523198:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:3301:x1873947616440448:12345-0@lo:400:kworker.0 Request processed in 29us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136066.523214:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1787136066.523252:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787136066.523469:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:247d1cf6-e699-400d-82b2-f0faea63f3e6:3301:1873947616440448:0@lo:400:kworker.0 00010000:00080000:1.0:1787136066.523485:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9881fa6d80 x1873947616440576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787136066.523495:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616440576:0@lo:400:kworker.0 00010000:00080000:1.0:1787136066.523527:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9881fa4380 x1873947616440704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787136066.523535:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616440704:0@lo:400:kworker.0 00010000:00010000:0.0:1787136067.160322:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787136067.354653:0:3299:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787136052/real 1787136052] req@ffff8e9881fa7b80 x1873947616436480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787136067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787136067.354682:0:3299:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e9881fa7b80 x1873947616436480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787136067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787136067.354693:0:3299:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787136052/real 1787136052] req@ffff8e9881fa5180 x1873947616436608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787136067 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787136067.354704:0:3299:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e9881fa5180 x1873947616436608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787136067 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787136067.354722:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e9865ef9800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787136067.354743:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787136067.354747:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616436480:0@lo:8:kworker.0 00000100:00080000:1.0:1787136067.354754:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e98496a4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787136067.354758:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787136067.354768:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616436608:0@lo:8:kworker.0 00000100:00100000:3.0:1787136067.357683:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:247d1cf6-e699-400d-82b2-f0faea63f3e6:3303:1873947616440832:0@lo:400:kworker.0 00000100:00100000:3.0:1787136067.357752:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787136067.357947:0:12897:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787136067.357951:0:12897:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787136067.357955:0:12897:0:(import.c:65:import_set_state_nolock()) ffff8e9865ef9800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787136067.357961:0:12897:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 412 00000100:00080000:0.0:1787136067.357966:0:12897:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787136067.357973:0:12897:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e9865ef9800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1787136067.357996:0:12897:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e98746b8380 x1873947616440960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787136067.358012:0:12897:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787136067.358015:0:12897:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787136067.358016:0:12897:0:(import.c:65:import_set_state_nolock()) ffff8e98496a4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787136067.358019:0:12897:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 412 00000100:00080000:0.0:1787136067.358031:0:12897:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787136067.358035:0:12897:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e98496a4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:0.0:1787136067.358184:0:12897:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e98746b9180 x1873947616441088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787136067.358232:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616440960:0@lo:8:kworker.0 00000100:00100000:0.0:1787136067.358263:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136067.358288:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616441088:0@lo:8:kworker.0 00000100:00100000:0.0:1787136067.358309:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136067.358339:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616441344:0@lo:400:kworker.0 00000100:00100000:0.0:1787136067.358365:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136067.358385:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787136067.358391:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616441216:0@lo:400:kworker.0 00000100:00100000:0.0:1787136067.358412:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136067.358447:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616440960 00000100:00100000:0.0:1787136067.358453:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616440960 00000100:00100000:0.0:1787136067.358477:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616441088 00000100:00100000:0.0:1787136067.358480:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616441088 00000100:00100000:0.0:1787136067.358493:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787136067.358500:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1873947616440960:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787136067.358540:0:15029:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:0.0:1787136067.358585:0:15029:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5850c552f203576 00002000:00100000:0.0:1787136067.358598:0:15029:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e974757c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113908 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787136067.358602:0:15029:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787136067.358604:0:15029:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787136067.358910:0:15029:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787136067.358936:0:15029:0:(import.c:65:import_set_state_nolock()) ffff8e9747578000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787136067.358994:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3299:x1873947616440960:12345-0@lo:8:kworker.0 Request processed in 493us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136067.359002:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787136067.359020:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787136067.359024:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1873947616441088:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787136067.359035:0:15029:0:(ldlm_lib.c:1195:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787136067.361099:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616440832 00000100:00100000:2.0:1787136067.361110:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616440832 00000100:00100000:2.0:1787136067.361153:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787136067.361161:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:3303:x1873947616440832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787136067.361872:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616441344 00000100:00100000:3.0:1787136067.361878:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616441344 00000100:00100000:3.0:1787136067.361912:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616441216 00000100:00100000:3.0:1787136067.361915:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616441216 00000100:00100000:3.0:1787136067.361927:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787136067.361934:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616441344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787136067.361986:0:14344:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787136067.361995:0:14344:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787136067.362095:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787136067.362101:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616441216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136067.362370:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:3303:x1873947616440832:12345-0@lo:400:kworker.0 Request processed in 1209us (4616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136067.362379:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787136067.362445:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:247d1cf6-e699-400d-82b2-f0faea63f3e6:3303:1873947616440832:0@lo:400:kworker.0 00000100:00100000:0.0:1787136067.366614:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1873947616441088:12345-0@lo:8:kworker.0 Request processed in 7579us (8294us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787136067.366629:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787136067.366773:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e98746b8380 x1873947616440960/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787136087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787136067.366786:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787136067.366796:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787136067.366806:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787136067.366812:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787136067.366816:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e9865ef9800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787136067.366853:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787136067.366860:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616440960:0@lo:8:kworker.0 00000100:00080000:0.0:1787136067.366874:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e98496a4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787136067.366878:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787136067.366881:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616441088:0@lo:8:kworker.0 00000004:00080000:2.0:1787136067.369774:0:14366:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787136067.369804:0:14366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14366:1873947616441600:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787136067.369874:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136067.369903:0:14366:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984380d300 going to sleep for 11 seconds 00000100:00100000:2.0:1787136067.369922:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616441472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787136067.369946:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136067.369998:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616441600 00000100:00100000:2.0:1787136067.370005:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616441600 00000100:00100000:2.0:1787136067.370072:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787136067.370081:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14366:x1873947616441600:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787136067.372533:0:15027:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787136067.372544:0:15027:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787136067.372551:0:15027:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:3.0:1787136067.375966:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616441344:12345-0@lo:400:kworker.0 Request processed in 14020us (17588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136067.375982:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:3.0:1787136067.376028:0:14365:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787136067.376421:0:14365:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 427319371932ns, next at 0ns, rc = 0 00010000:00080000:3.0:1787136067.376493:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e98746b8a80 x1873947616441344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787136067.376508:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616441344:0@lo:400:kworker.0 00000100:00100000:1.0:1787136067.381105:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1873947616441216:12345-0@lo:400:kworker.0 Request processed in 18994us (22681us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136067.381120:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787136067.383748:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616441472 00000100:00100000:1.0:1787136067.383761:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616441472 00000100:00100000:1.0:1787136067.383810:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787136067.383820:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1873947616441472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787136067.383857:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787136067.383940:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1873947616441472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (13991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136067.383948:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787136067.384016:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9876bd0700 x1873947616441472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787136083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787136067.384040:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616441472:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787136067.394960:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787136067.396598:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e98746bb480 x1873947616441216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787136067.396617:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3301:1873947616441216:0@lo:400:kworker.0 00002000:00010000:2.0:1787136067.408077:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.408092:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f20357d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408111:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.408123:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.408130:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f20357d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408150:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f20357d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408161:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f20357d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408169:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f20357d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408191:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136067.408203:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.408209:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f20357d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408217:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9ac00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.408221:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f20357d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408231:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f20357d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408248:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f20357d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408268:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f20357d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408286:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.408288:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.408290:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136067.408825:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.408832:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309dec7/0xf5850c552f203584 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408844:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.408847:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.408851:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b309dec7/0xf5850c552f203584 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408862:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b309dec7/0xf5850c552f203584 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408870:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b309dec7/0xf5850c552f203584 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408878:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b309dec7/0xf5850c552f203584 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.408904:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787136067.408936:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787136067.408943:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b309dec7/0xf5850c552f203584 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.408951:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a800 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136067.408955:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309dec7/0xf5850c552f203584 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.408976:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b309dec7/0xf5850c552f203584 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.408990:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b309dec7/0xf5850c552f203584 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.408997:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b309dec7/0xf5850c552f203584 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.409013:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136067.409015:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136067.409017:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136067.409335:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.409346:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f20358b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409355:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.409358:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.409363:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f20358b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409372:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f20358b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409381:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f20358b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409388:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f20358b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409402:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136067.409411:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.409416:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f20358b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409422:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9ba00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.409425:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f20358b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409433:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f20358b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409452:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f20358b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409459:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f20358b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409473:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.409474:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.409476:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136067.409881:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.409887:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030495421/0xf5850c552f203592 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409896:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.409900:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.409904:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030495421/0xf5850c552f203592 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409913:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030495421/0xf5850c552f203592 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409921:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030495421/0xf5850c552f203592 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409928:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030495421/0xf5850c552f203592 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.409961:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787136067.410115:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787136067.410121:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030495421/0xf5850c552f203592 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.410130:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a200 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136067.410133:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030495421/0xf5850c552f203592 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.410142:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030495421/0xf5850c552f203592 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.410155:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030495421/0xf5850c552f203592 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.410173:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030495421/0xf5850c552f203592 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.410187:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136067.410189:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136067.410191:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136067.410373:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.410379:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f203599 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.410388:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.410391:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.410395:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f203599 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.410403:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f203599 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.410411:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f203599 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.410419:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f203599 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.410432:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136067.410441:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.410445:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f203599 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.410451:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9b400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.410461:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f203599 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.410469:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f203599 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.410481:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f203599 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.410488:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f203599 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.410500:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.410502:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.410504:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136067.410911:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.410917:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000ed46ae/0xf5850c552f2035a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.410926:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.410929:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.410932:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000000ed46ae/0xf5850c552f2035a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.420515:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000000ed46ae/0xf5850c552f2035a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.420543:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000000ed46ae/0xf5850c552f2035a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.420573:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000000ed46ae/0xf5850c552f2035a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.420597:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787136067.420694:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787136067.420703:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000000ed46ae/0xf5850c552f2035a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.420711:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9b600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136067.420716:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000000ed46ae/0xf5850c552f2035a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.420724:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000000ed46ae/0xf5850c552f2035a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.420746:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000000ed46ae/0xf5850c552f2035a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.420753:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000000ed46ae/0xf5850c552f2035a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.420775:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136067.420777:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136067.420779:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136067.427829:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.427844:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f542c245/0xf5850c552f2035a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.427861:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.427865:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.427871:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f542c245/0xf5850c552f2035a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.427885:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f542c245/0xf5850c552f2035a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.427895:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f542c245/0xf5850c552f2035a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.427976:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f542c245/0xf5850c552f2035a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.427995:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136067.428009:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.428015:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f542c245/0xf5850c552f2035a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.428028:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9bc00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.428033:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f542c245/0xf5850c552f2035a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.428042:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f542c245/0xf5850c552f2035a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.428087:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f542c245/0xf5850c552f2035a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.428095:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f542c245/0xf5850c552f2035a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.428115:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.428117:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.428119:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136067.430122:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.430135:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f2035ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.430152:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.430156:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.430161:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f2035ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.430174:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f2035ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.430193:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f2035ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.430201:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f2035ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.430225:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787136067.430243:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787136067.430250:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f2035ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.430259:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9ba00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136067.430263:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f2035ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.430273:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f2035ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.430288:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f2035ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.430295:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011a54e3d/0xf5850c552f2035ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.430311:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136067.430313:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136067.430314:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136067.431486:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.431495:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f2035b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.431509:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.431513:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.431518:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f2035b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.431528:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f2035b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.431807:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f2035b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.431815:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f2035b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.431884:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787136067.435086:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.435100:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc1b5bb/0xf5850c552f2035bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.435117:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.435121:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.435128:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bc1b5bb/0xf5850c552f2035bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.435141:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bc1b5bb/0xf5850c552f2035bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.435151:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc1b5bb/0xf5850c552f2035bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.435159:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bc1b5bb/0xf5850c552f2035bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.440497:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787136067.440512:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f2035b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.440538:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9ac00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787136067.440543:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f2035b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.440554:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f2035b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.440588:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f2035b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.440597:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bde00ec8/0xf5850c552f2035b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.440618:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787136067.440621:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bc1b5bb/0xf5850c552f2035bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.440627:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9ae00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787136067.440630:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc1b5bb/0xf5850c552f2035bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.440700:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc1b5bb/0xf5850c552f2035bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.440711:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bc1b5bb/0xf5850c552f2035bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.440723:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136067.440725:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136067.440726:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136067.443489:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.443490:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787136067.443502:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bc1b5bb/0xf5850c552f2035bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787136067.443853:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787136067.446913:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.446927:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b95b6321/0xf5850c552f2035c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.446950:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.446955:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.446961:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b95b6321/0xf5850c552f2035c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.446977:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b95b6321/0xf5850c552f2035c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.446988:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b95b6321/0xf5850c552f2035c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.446996:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b95b6321/0xf5850c552f2035c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.447027:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787136067.447551:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.447570:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e5a625/0xf5850c552f2035ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.447581:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.447585:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.447589:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e5a625/0xf5850c552f2035ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.447599:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2e5a625/0xf5850c552f2035ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.447618:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2e5a625/0xf5850c552f2035ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.447625:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2e5a625/0xf5850c552f2035ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.447658:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787136067.447673:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787136067.447679:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b95b6321/0xf5850c552f2035c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.447687:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.447692:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b95b6321/0xf5850c552f2035c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.447701:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b95b6321/0xf5850c552f2035c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.447722:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b95b6321/0xf5850c552f2035c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.447729:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b95b6321/0xf5850c552f2035c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.448773:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787136067.448921:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136067.448929:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2e5a625/0xf5850c552f2035ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.448942:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9b000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787136067.448947:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e5a625/0xf5850c552f2035ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.448957:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2e5a625/0xf5850c552f2035ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.448974:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2e5a625/0xf5850c552f2035ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.448981:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2e5a625/0xf5850c552f2035ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.448999:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136067.449001:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136067.449002:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136067.449007:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136067.449015:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.450853:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.450869:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.450872:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136067.453549:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.453573:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f2035d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.453590:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.453594:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.453601:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f2035d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.453614:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f2035d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.453624:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f2035d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.453631:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f2035d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.457078:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787136067.457761:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.457773:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f2035d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.457789:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1787136067.457794:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136067.457800:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f2035d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.457820:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f2035d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.457831:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f2035d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.457839:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f2035d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.465919:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787136067.465934:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f2035d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.465948:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9b400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787136067.465953:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f2035d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.465965:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f2035d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.465987:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f2035d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136067.465995:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a16c4169/0xf5850c552f2035d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.467021:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787136067.467032:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f2035d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.467042:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9aa00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136067.467067:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f2035d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.467097:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f2035d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.467113:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f2035d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.467135:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136067.467138:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136067.467140:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.469072:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787136067.469086:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f2035d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.469182:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787136067.470399:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.470409:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1ee6cd2/0xf5850c552f2035df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.470487:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.470493:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.470500:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1ee6cd2/0xf5850c552f2035df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.470514:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1ee6cd2/0xf5850c552f2035df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.470523:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1ee6cd2/0xf5850c552f2035df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.470531:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1ee6cd2/0xf5850c552f2035df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.470579:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136067.470601:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.470609:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1ee6cd2/0xf5850c552f2035df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.470620:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afc00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.470625:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1ee6cd2/0xf5850c552f2035df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.470635:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1ee6cd2/0xf5850c552f2035df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.470665:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1ee6cd2/0xf5850c552f2035df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.470681:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1ee6cd2/0xf5850c552f2035df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.470700:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.470703:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.470706:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787136067.471938:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.471949:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f2035e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.471963:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.471967:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.471972:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f2035e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.471982:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f2035e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.471992:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f2035e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.472000:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f2035e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.472028:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136067.472087:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.472095:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f2035e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.472105:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae200 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.472109:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f2035e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.472119:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f2035e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.472134:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f2035e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.472143:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f2035e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.472160:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.472162:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.472164:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787136067.474474:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.474486:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033d334d2/0xf5850c552f2035ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.474502:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.474514:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.474520:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033d334d2/0xf5850c552f2035ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.474534:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033d334d2/0xf5850c552f2035ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.474544:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033d334d2/0xf5850c552f2035ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.474552:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033d334d2/0xf5850c552f2035ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.474595:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136067.474631:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.474640:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033d334d2/0xf5850c552f2035ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.474649:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afe00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.474654:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033d334d2/0xf5850c552f2035ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.474664:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033d334d2/0xf5850c552f2035ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.474681:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033d334d2/0xf5850c552f2035ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.474689:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033d334d2/0xf5850c552f2035ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.474710:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.474712:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.474715:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787136067.475086:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.475092:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f2035f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.475102:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.475105:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.475110:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f2035f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.475120:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f2035f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.475129:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f2035f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.475142:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f2035f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.475164:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136067.475184:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.475191:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f2035f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.475200:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aee00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.475204:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f2035f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.475224:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f2035f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.475236:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f2035f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.475242:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003366e64f/0xf5850c552f2035f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.475260:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.475262:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.475263:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787136067.476007:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.476014:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2035fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.476024:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.476027:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.476031:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2035fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.476041:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2035fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.476069:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2035fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.476077:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2035fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.476144:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787136067.476705:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.476712:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203602 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.476727:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.476730:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.476734:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.476744:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.476751:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.476758:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.477640:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787136067.477651:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2035fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.477662:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533af400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.477666:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2035fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.477676:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2035fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.477693:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2035fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.477718:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000839a6e4e/0xf5850c552f2035fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.477739:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.477743:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203602 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.477749:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.477752:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203602 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.477759:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203602 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.477769:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203602 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.477777:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.477778:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.477781:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136067.479957:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787136067.479969:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203602 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787136067.480720:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.480728:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203609 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.480742:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.480746:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.480752:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.480776:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.480786:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.480793:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203609 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.480918:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787136067.480991:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787136067.481000:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203609 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.481021:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136067.481026:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203609 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.481035:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203609 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.481077:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203609 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.481086:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203609 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.481103:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136067.481105:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136067.481107:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.481361:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787136067.481596:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.481602:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f203610 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.481611:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.481614:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.481618:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f203610 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.481626:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f203610 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.481634:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f203610 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.481651:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f203610 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.481702:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787136067.482195:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.482202:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b08deaf3/0xf5850c552f203617 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.482211:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.482214:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.482219:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b08deaf3/0xf5850c552f203617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.482228:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b08deaf3/0xf5850c552f203617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.482236:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b08deaf3/0xf5850c552f203617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.482243:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b08deaf3/0xf5850c552f203617 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.484511:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787136067.484524:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f203610 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.484538:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533aec00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.484548:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f203610 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.484570:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f203610 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.484592:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f203610 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.484600:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a7ddb44/0xf5850c552f203610 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.484626:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.484630:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b08deaf3/0xf5850c552f203617 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.484636:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae800 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.484639:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b08deaf3/0xf5850c552f203617 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.484647:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b08deaf3/0xf5850c552f203617 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.484657:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b08deaf3/0xf5850c552f203617 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.484664:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.484671:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.484673:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136067.485027:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787136067.485035:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b08deaf3/0xf5850c552f203617 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.485228:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787136067.486009:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.486017:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077831bce/0xf5850c552f20361e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.486029:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.486034:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.486040:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077831bce/0xf5850c552f20361e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.487539:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077831bce/0xf5850c552f20361e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.487566:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077831bce/0xf5850c552f20361e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.487575:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077831bce/0xf5850c552f20361e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.487596:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787136067.488243:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136067.488349:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.488357:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077831bce/0xf5850c552f20361e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.488367:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.488371:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077831bce/0xf5850c552f20361e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.488381:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077831bce/0xf5850c552f20361e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.488400:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077831bce/0xf5850c552f20361e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.488408:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077831bce/0xf5850c552f20361e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.488496:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047ddcd8/0xf5850c552f203625 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.488508:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.488513:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.488524:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000047ddcd8/0xf5850c552f203625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.488535:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000047ddcd8/0xf5850c552f203625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.488544:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000047ddcd8/0xf5850c552f203625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.488552:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000047ddcd8/0xf5850c552f203625 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.488580:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136067.488882:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.488888:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000047ddcd8/0xf5850c552f203625 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.488895:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511da600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.488899:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000047ddcd8/0xf5850c552f203625 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.488920:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000047ddcd8/0xf5850c552f203625 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.488932:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000047ddcd8/0xf5850c552f203625 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.488939:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000047ddcd8/0xf5850c552f203625 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.488953:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.488955:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.488957:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.488966:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787136067.489737:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.489748:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc012c2/0xf5850c552f20362c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.489761:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.489764:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.489768:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009dc012c2/0xf5850c552f20362c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.489778:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009dc012c2/0xf5850c552f20362c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.489787:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009dc012c2/0xf5850c552f20362c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.489805:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009dc012c2/0xf5850c552f20362c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.489886:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787136067.489899:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787136067.490604:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009dc012c2/0xf5850c552f20362c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.490616:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db200 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136067.490620:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc012c2/0xf5850c552f20362c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.490630:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009dc012c2/0xf5850c552f20362c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.491118:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009dc012c2/0xf5850c552f20362c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.491126:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009dc012c2/0xf5850c552f20362c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.491217:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136067.491221:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136067.491224:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787136067.491802:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.491811:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023628ab0/0xf5850c552f203633 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.491873:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.491878:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.491883:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023628ab0/0xf5850c552f203633 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.491896:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023628ab0/0xf5850c552f203633 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.491905:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023628ab0/0xf5850c552f203633 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.491913:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023628ab0/0xf5850c552f203633 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.492514:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787136067.492851:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787136067.492859:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023628ab0/0xf5850c552f203633 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.492868:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511da400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136067.492872:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023628ab0/0xf5850c552f203633 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.492881:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023628ab0/0xf5850c552f203633 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.492896:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023628ab0/0xf5850c552f203633 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.492903:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023628ab0/0xf5850c552f203633 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136067.492930:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136067.492932:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136067.492933:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787136067.497233:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787136067.497245:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000353a6197/0xf5850c552f20363a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.497332:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=427s v=(0 0) 00010000:00010000:1.0:1787136067.497337:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136067.497343:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000353a6197/0xf5850c552f20363a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.497358:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000353a6197/0xf5850c552f20363a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.497368:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000353a6197/0xf5850c552f20363a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.497376:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000353a6197/0xf5850c552f20363a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136067.497497:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787136067.497704:0:15027:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1787136067.497794:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14366:x1873947616441600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 127710us (127916us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136067.497807:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787136067.497902:0:14366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14366:1873947616441600:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787136067.497917:0:14366:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787136067.497964:0:14366:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14366:1873947616441728:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787136067.498000:0:14366:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136067.498066:0:14366:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843317c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787136067.498215:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616441728 00000100:00100000:1.0:1787136067.498221:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616441728 00000100:00100000:1.0:1787136067.498347:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787136067.498357:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14366:x1873947616441728:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787136067.498392:0:15029:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1787136067.503673:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136067.503688:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000353a6197/0xf5850c552f20363a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.503702:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511daa00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136067.503708:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000353a6197/0xf5850c552f20363a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.503720:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000353a6197/0xf5850c552f20363a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.503743:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000353a6197/0xf5850c552f20363a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.503773:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000353a6197/0xf5850c552f20363a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136067.503797:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.503799:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136067.503801:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787136067.513223:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14366:x1873947616441728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14860us (15215us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787136067.513236:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787136067.513305:0:14366:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14366:1873947616441728:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787136067.513320:0:14366:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1787136068.185714:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787136068.612033:0:15746:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787136068.612037:0:15746:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787136068.612208:0:15746:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e9851ee2000 00000020:01000004:3.0:1787136068.612224:0:15746:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1787136068.612236:0:15746:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787136068.612250:0:15746:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e9744a999c0) 00000020:00000080:3.0:1787136068.612269:0:15746:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787136068.631133:0:15746:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787136068.631402:0:15746:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1787136068.632640:0:15746:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787136068.634513:0:15746:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1787136068.635137:0:15746:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1787136068.635586:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 407: rc = 0 00100000:10000000:3.0:1787136068.635819:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 407: rc = 0 00100000:10000000:3.0:1787136068.635974:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 407: rc = 0 00100000:10000000:3.0:1787136068.636603:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:3.0:1787136068.637136:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 646: rc = 0 00100000:10000000:3.0:1787136068.637402:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 646: rc = 0 00100000:10000000:3.0:1787136068.637921:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 646: rc = 0 00100000:10000000:2.0:1787136068.638526:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 646: rc = 0 00100000:10000000:2.0:1787136068.638955:0:15746:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 646: rc = 0 00000020:00000080:2.0:1787136068.639981:0:15746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1787136068.639996:0:15746:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787136068.640008:0:15746:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf5850c552f203648 00000020:01000004:2.0:1787136068.640016:0:15746:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1787136068.640037:0:15746:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.138@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787136068.640040:0:15746:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.138@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787136068.640135:0:15746:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1787136068.640158:0:15746:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1787136068.640163:0:15746:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.138@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787136068.655632:0:15746:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.138@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787136068.655680:0:15746:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.138@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787136068.655685:0:15746:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787136068.655686:0:15746:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787136068.655688:0:15746:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787136068.655689:0:15746:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787136068.655689:0:15746:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787136068.655691:0:15746:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787136068.655692:0:15746:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787136068.655694:0:15746:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787136068.655696:0:15746:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787136068.655699:0:15746:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787136068.655701:0:15746:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787136068.655703:0:15746:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787136068.655704:0:15746:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787136068.655705:0:15746:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787136068.655706:0:15746:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787136068.655707:0:15746:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787136068.655708:0:15746:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787136068.655709:0:15746:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787136068.655710:0:15746:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787136068.656004:0:15746:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787136068.656026:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616441856:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787136068.656137:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136068.656200:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843317540 going to sleep for 11 seconds 00000100:00100000:1.0:1787136068.656416:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616441856 00000100:00100000:1.0:1787136068.656424:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616441856 00000100:00100000:1.0:1787136068.656493:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787136068.656503:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15746:x1873947616441856:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787136068.656533:0:14335:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787136068.656536:0:14335:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787136068.656540:0:14335:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787136068.684131:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15746:x1873947616441856:12345-0@lo:253:mount.lustre.0 Request processed in 27620us (27985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136068.684146:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787136068.687297:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616441856:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787136068.687318:0:15746:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787136068.687322:0:15746:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787136068.687323:0:15746:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787136068.687325:0:15746:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787136068.687326:0:15746:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787136068.687328:0:15746:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787136068.687329:0:15746:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787136068.687330:0:15746:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787136068.687332:0:15746:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787136068.687333:0:15746:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787136068.687361:0:15746:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e9851ee2000 from lustre-OST0001 10000000:01000000:1.0:1787136068.687389:0:15746:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787136068.687392:0:15746:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787136068.687400:0:15746:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e98434699c0 local copy 00010000:00010000:1.0:1787136068.687412:0:15746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2033f5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136068.687684:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616441984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787136068.687919:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.687967:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457db900 going to sleep for 11 seconds 00000100:00100000:2.0:1787136068.688081:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616441984 00000100:00100000:2.0:1787136068.688090:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616441984 00000100:00100000:2.0:1787136068.688141:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787136068.688150:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15746:x1873947616441984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787136068.688341:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15746:x1873947616441984:12345-0@lo:501:mount.lustre.0 Request processed in 192us (421us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787136068.688349:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787136068.688620:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616441984:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787136068.688637:0:15746:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.138@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787136068.688818:0:15746:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.138@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787136068.688826:0:15746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2033f5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.688844:0:15746:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98413cba00/0xf5850c552f2033ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2033f5 expref: -99 pid: 14325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787136068.688869:0:15746:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e9851ee2000 10000000:01000000:1.0:1787136068.688874:0:15746:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787136068.688879:0:15746:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787136068.688882:0:15746:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787136068.688886:0:15746:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787136068.688888:0:15746:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787136068.688914:0:15746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511dbc00/0xf5850c552f20364f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.688921:0:15746:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98511dbc00/0xf5850c552f20364f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.688931:0:15746:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98511dbc00/0xf5850c552f20364f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136068.688945:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787136068.688978:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.688998:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457db900 going to sleep for 11 seconds 00000100:00100000:0.0:1787136068.689183:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616442112 00000100:00100000:0.0:1787136068.689189:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616442112 00000100:00100000:0.0:1787136068.689224:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787136068.689232:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:15746:x1873947616442112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787136068.689260:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787136068.689275:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9874896800/0xf5850c552f203656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20364f expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136068.689298:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9874896800/0xf5850c552f203656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20364f expref: 17 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136068.689308:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9874896800/0xf5850c552f203656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20364f expref: 17 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136068.689316:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896800, rc 0) 00000100:00100000:0.0:1787136068.689358:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:15746:x1873947616442112:12345-0@lo:101:mount.lustre.0 Request processed in 127us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136068.689365:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787136068.689522:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787136068.689535:0:15746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98511dbc00/0xf5850c552f20364f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203656 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.689545:0:15746:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98511dbc00/0xf5850c552f20364f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f203656 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787136068.690574:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787136068.692829:0:15746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787136068.693157:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787136068.693204:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787136068.693254:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787136068.693307:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787136068.693344:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787136068.693395:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787136068.693462:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787136068.693470:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787136068.693568:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787136068.693629:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.693670:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457db840 going to sleep for 11 seconds 00000100:00100000:0.0:1787136068.694147:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616442240 00000100:00100000:0.0:1787136068.694156:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616442240 00000100:00100000:0.0:1787136068.694210:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787136068.694219:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:15746:x1873947616442240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787136068.694589:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:15746:x1873947616442240:12345-0@lo:501:mount.lustre.0 Request processed in 370us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136068.694597:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787136068.694949:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787136068.694993:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442368:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787136068.695037:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.695128:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457db840 going to sleep for 11 seconds 00000100:00100000:2.0:1787136068.699102:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616442368 00000100:00100000:2.0:1787136068.699117:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616442368 00000100:00100000:3.0:1787136068.699316:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787136068.699328:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:15746:x1873947616442368:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787136068.700096:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:15746:x1873947616442368:12345-0@lo:503:mount.lustre.0 Request processed in 767us (5055us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136068.700116:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787136068.700453:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442368:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787136068.701519:0:15746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787136068.701611:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787136068.702156:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.702201:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457db840 going to sleep for 11 seconds 00000100:00100000:2.0:1787136068.702287:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616442496 00000100:00100000:2.0:1787136068.702294:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616442496 00000100:00100000:2.0:1787136068.702333:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787136068.702342:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:15746:x1873947616442496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787136068.702582:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:15746:x1873947616442496:12345-0@lo:502:mount.lustre.0 Request processed in 241us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136068.702590:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787136068.702904:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787136068.703198:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787136068.703348:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787136068.703399:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787136068.703450:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787136068.703483:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787136068.703515:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787136068.703793:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787136068.703840:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787136068.703889:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787136068.703928:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442624:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787136068.703984:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.704019:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457db840 going to sleep for 11 seconds 00000100:00100000:3.0:1787136068.704221:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616442624 00000100:00100000:3.0:1787136068.704228:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616442624 00000100:00100000:3.0:1787136068.704509:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787136068.704519:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:15746:x1873947616442624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787136068.704849:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:15746:x1873947616442624:12345-0@lo:502:mount.lustre.0 Request processed in 331us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136068.704858:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787136068.704986:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442624:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787136068.705099:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787136068.705110:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1787136068.706089:0:15747:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787136068.706100:0:15747:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787136068.706106:0:15747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787136068.706108:0:15747:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787136068.706112:0:15747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787136068.706127:0:15747:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e9876bc0000) 00000020:00000080:1.0:1787136068.706148:0:15747:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787136068.706154:0:15747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787136068.706219:0:15747:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e9851ee2000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787136068.706227:0:15747:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787136068.706308:0:15747:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf5850c552f203664 00010000:00010000:1.0:1787136068.711418:0:15747:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1787136068.712304:0:15747:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1787136068.714644:0:15747:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1787136068.720562:0:15747:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787136068.720579:0:15747:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787136068.720588:0:15747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787136068.720590:0:15747:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787136068.720595:0:15747:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787136068.720599:0:15747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787136068.720601:0:15747:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787136068.720604:0:15747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787136068.720606:0:15747:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787136068.720609:0:15747:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787136068.720611:0:15747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787136068.720613:0:15747:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1787136068.720615:0:15747:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787136068.720617:0:15747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787136068.720618:0:15747:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787136068.720622:0:15747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1787136068.720696:0:15747:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787136068.720701:0:15747:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787136068.720702:0:15747:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787136068.720705:0:15747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787136068.720882:0:15746:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787136068.720910:0:15746:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787136068.720930:0:15746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511dbc00/0xf5850c552f20364f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203656 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.720950:0:15746:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98511dbc00/0xf5850c552f20364f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203656 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787136068.720958:0:15746:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e9851ee2000 from 1 10000000:01000000:1.0:1787136068.720961:0:15746:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787136068.720997:0:15746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.721005:0:15746:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.721015:0:15746:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136068.721038:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787136068.721144:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.721184:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457dbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787136068.721480:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616442752 00000100:00100000:2.0:1787136068.721489:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616442752 00000100:00100000:2.0:1787136068.721543:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787136068.721563:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:15746:x1873947616442752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787136068.721577:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787136068.721591:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9876c9b800/0xf5850c552f203672 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f20366b expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.721614:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9876c9b800/0xf5850c552f203672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f20366b expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.721624:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9876c9b800/0xf5850c552f203672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20366b expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.721632:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9876c9b800, rc 0) 00000100:00100000:2.0:1787136068.721689:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:15746:x1873947616442752:12345-0@lo:101:mount.lustre.0 Request processed in 128us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136068.721696:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787136068.721780:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787136068.721795:0:15746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203672 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.721804:0:15746:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f203672 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787136068.722315:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787136068.722579:0:15746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787136068.722796:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787136068.722834:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787136068.722899:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787136068.722907:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787136068.722959:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787136068.723000:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.723036:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457dbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787136068.723208:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616442880 00000100:00100000:2.0:1787136068.723215:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616442880 00000100:00100000:2.0:1787136068.723495:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787136068.723505:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:15746:x1873947616442880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787136068.723764:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aaf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:15746:x1873947616442880:12345-0@lo:501:mount.lustre.0 Request processed in 260us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136068.723772:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787136068.731515:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616442880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787136068.731591:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787136068.731811:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.731894:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457dbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787136068.734578:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616443008 00000100:00100000:2.0:1787136068.734592:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616443008 00000100:00100000:2.0:1787136068.735083:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787136068.735094:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:15746:x1873947616443008:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787136068.735924:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:15746:x1873947616443008:12345-0@lo:503:mount.lustre.0 Request processed in 829us (4109us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136068.735935:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787136068.736802:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443008:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787136068.737362:0:15746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787136068.737439:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787136068.737499:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.737536:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457dbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787136068.737921:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616443136 00000100:00100000:2.0:1787136068.737929:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616443136 00000100:00100000:2.0:1787136068.737976:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787136068.737985:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:15746:x1873947616443136:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787136068.738190:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c793050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:15746:x1873947616443136:12345-0@lo:502:mount.lustre.0 Request processed in 205us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136068.738198:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787136068.738981:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443136:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787136068.741524:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787136068.741646:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787136068.741712:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787136068.743420:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787136068.743474:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787136068.743539:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787136068.743592:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787136068.743624:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787136068.743674:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787136068.745040:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136068.746411:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9852e00540 going to sleep for 11 seconds 00000100:00100000:3.0:1787136068.746680:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616443264 00000100:00100000:3.0:1787136068.746689:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616443264 00000100:00100000:3.0:1787136068.746767:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787136068.746777:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:15746:x1873947616443264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787136068.747020:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c793c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:15746:x1873947616443264:12345-0@lo:502:mount.lustre.0 Request processed in 244us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136068.747028:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787136068.747525:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787136068.747702:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1787136068.747718:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787136068.754742:0:15751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787136068.754755:0:15751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136068.754758:0:15751:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787136068.754764:0:15751:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e9851ee2000 00000020:00000080:2.0:1787136068.754767:0:15751:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787136068.754773:0:15751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787136068.754775:0:15751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136068.754776:0:15751:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787136068.754778:0:15751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787136068.754780:0:15751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136068.754781:0:15751:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787136068.754783:0:15751:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e9851ee2000 00000020:00000080:2.0:1787136068.754785:0:15751:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787136068.754880:0:15751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787136068.754885:0:15751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136068.754886:0:15751:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787136068.754888:0:15751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787136068.754890:0:15751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136068.754892:0:15751:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787136068.754895:0:15751:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e9851ee2000 00000020:00000080:2.0:1787136068.754897:0:15751:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787136068.760021:0:15751:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787136068.760032:0:15751:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787136068.760035:0:15751:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787136068.760039:0:15751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1787136068.770728:0:15746:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1787136068.770901:0:15746:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787136068.770986:0:15746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203672 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.771001:0:15746:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203672 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787136068.771598:0:15746:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787136068.771603:0:15746:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e9851ee2000 10000000:01000000:1.0:1787136068.771606:0:15746:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e9851ee2000 10000000:01000000:1.0:1787136068.771611:0:15746:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787136068.771617:0:15746:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff8e9851ee2000 from 1 10000000:01000000:1.0:1787136068.771626:0:15746:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787136068.771663:0:15746:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511da800/0xf5850c552f203679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.771675:0:15746:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98511da800/0xf5850c552f203679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.771686:0:15746:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98511da800/0xf5850c552f203679 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136068.771711:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787136068.771781:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.771819:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616443392 00000100:00100000:1.0:1787136068.771825:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616443392 00000100:00100000:1.0:1787136068.773322:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787136068.773341:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:15746:x1873947616443392:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787136068.773357:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136068.773374:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511dba00/0xf5850c552f203680 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f203679 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.773399:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511dba00/0xf5850c552f203680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f203679 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.773420:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511dba00/0xf5850c552f203680 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203679 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.773429:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dba00, rc 0) 00000100:00100000:1.0:1787136068.773491:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:15746:x1873947616443392:12345-0@lo:101:mount.lustre.0 Request processed in 158us (1709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136068.773497:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787136068.773575:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457db840 going to sleep for 11 seconds 00000100:00100000:1.0:1787136068.773602:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787136068.773618:0:15746:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98511da800/0xf5850c552f203679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203680 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.773627:0:15746:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98511da800/0xf5850c552f203679 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f203680 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787136068.774362:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1787136068.774846:0:15746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787136068.775132:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787136068.775191:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787136068.775229:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787136068.775281:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787136068.775320:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787136068.775372:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787136068.775409:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787136068.775447:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787136068.775497:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787136068.775534:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787136068.775587:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787136068.775637:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787136068.775675:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787136068.775710:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787136068.775761:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787136068.775798:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787136068.775836:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787136068.775907:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787136068.775962:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787136068.776025:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787136068.776118:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787136068.776174:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787136068.776235:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787136068.776283:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787136068.776318:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787136068.776353:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787136068.776418:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787136068.776460:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787136068.776495:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787136068.776544:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1787136068.780116:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1787136068.780156:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1787136068.780183:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1787136068.780262:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1787136068.780290:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1787136068.781006:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1787136068.781088:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1787136068.781230:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1787136068.781241:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1787136068.782003:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787136068.782093:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.782142:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98457db840 going to sleep for 11 seconds 00000100:00100000:1.0:1787136068.782257:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616443520 00000100:00100000:1.0:1787136068.782264:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616443520 00000100:00100000:1.0:1787136068.782306:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787136068.782389:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:15746:x1873947616443520:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787136068.782670:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:15746:x1873947616443520:12345-0@lo:501:mount.lustre.0 Request processed in 355us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136068.782678:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787136068.782893:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443520:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787136068.782949:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443648:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787136068.782993:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136068.783033:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e986030ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1787136068.783123:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616443648 00000100:00100000:3.0:1787136068.783129:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616443648 00000100:00100000:3.0:1787136068.783159:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787136068.783169:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:15746:x1873947616443648:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787136068.783474:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:15746:x1873947616443648:12345-0@lo:503:mount.lustre.0 Request processed in 307us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136068.783482:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787136068.790907:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443648:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787136068.796854:0:15746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787136068.796966:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443776:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787136068.797042:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136068.797101:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e986030ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787136068.797109:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616443776 00000100:00100000:1.0:1787136068.797119:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616443776 00000100:00100000:1.0:1787136068.797164:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787136068.797182:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:15746:x1873947616443776:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787136068.800172:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:15746:x1873947616443776:12345-0@lo:502:mount.lustre.0 Request processed in 2984us (3122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136068.800187:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787136068.800313:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443776:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787136068.800632:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787136068.800709:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787136068.801539:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787136068.801623:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787136068.802017:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787136068.802104:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787136068.802211:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787136068.802798:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787136068.802869:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787136068.802906:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787136068.802941:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787136068.802991:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787136068.803028:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787136068.803089:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787136068.805002:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787136068.805094:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787136068.805958:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787136068.806031:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787136068.806097:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787136068.806148:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787136068.806209:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787136068.806281:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787136068.806323:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787136068.806393:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787136068.806438:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787136068.806481:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787136068.806562:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787136068.806613:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787136068.806667:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787136068.806748:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787136068.806785:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787136068.806818:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787136068.806868:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787136068.806919:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787136068.806955:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787136068.807020:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787136068.807101:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787136068.807147:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787136068.807214:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787136068.807264:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787136068.807327:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787136068.807407:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.807455:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9874107e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787136068.807582:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616443904 00000100:00100000:3.0:1787136068.807591:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616443904 00000100:00100000:3.0:1787136068.807643:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787136068.807653:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:15746:x1873947616443904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787136068.807907:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:15746:x1873947616443904:12345-0@lo:502:mount.lustre.0 Request processed in 255us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136068.807916:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787136068.807974:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616443904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787136068.808090:0:15746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787136068.808105:0:15746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787136068.809519:0:15756:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787136068.809534:0:15756:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e9744a98000) 00000020:00000080:3.0:1787136068.809565:0:15756:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787136068.812895:0:15756:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e9851ee2000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787136068.812975:0:15756:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e9851ee2000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787136068.812979:0:15756:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e9851ee2000 3 00010000:00080000:3.0:1787136068.813013:0:15756:0:(ldlm_lib.c:103:import_set_conn()) imp ffff8e98456a2000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.138@tcp at head 00010000:00010000:3.0:1787136068.818737:0:15756:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1787136068.818851:0:15756:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1787136068.818889:0:15756:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1787136068.818900:0:15756:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf5850c552f20368e 00000100:00080000:3.0:1787136068.818910:0:15756:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787136068.818916:0:15756:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e98456a2000 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:3.0:1787136068.818951:0:15756:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e974499dc00 x1873947616444032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787136068.818984:0:15756:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787136068.819221:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1873947616444032:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787136068.819315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787136068.819800:0:12897:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787136068.819805:0:12897:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787136068.819808:0:12897:0:(import.c:65:import_set_state_nolock()) ffff8e98496a4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787136068.819813:0:12897:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 427 00000100:00080000:2.0:1787136068.819817:0:12897:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787136068.819822:0:12897:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e98496a4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1787136068.819838:0:12897:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9876bd3480 x1873947616444288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787136068.819884:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616444416:0@lo:400:kworker.0 00000100:00100000:2.0:1787136068.819918:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136068.819940:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787136068.819945:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616444544:0@lo:400:kworker.0 00000100:00100000:2.0:1787136068.819964:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.821785:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616444160:0@lo:400:kworker.0 00000100:00100000:1.0:1787136068.821848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.821909:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616444160 00000100:00100000:1.0:1787136068.821916:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616444160 00000100:00100000:1.0:1787136068.821961:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787136068.821972:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1873947616444160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787136068.822025:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1873947616444160:12345-0@lo:400:kworker.0 Request processed in 55us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136068.822033:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787136068.822093:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616444160:0@lo:400:kworker.0 00000100:00100000:1.0:1787136068.822131:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616444288:0@lo:8:kworker.0 00000100:00100000:1.0:1787136068.822174:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136068.822205:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616444288 00000100:00100000:1.0:1787136068.822209:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616444288 00000100:00100000:1.0:1787136068.822228:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787136068.822233:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1873947616444288:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1787136068.822486:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3299:x1873947616444288:12345-0@lo:8:kworker.0 Request processed in 251us (310us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787136068.822493:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787136068.822517:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787136068.822523:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e98496a4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787136068.822527:0:3299:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787136068.822530:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616444288:0@lo:8:kworker.0 00000100:00100000:0.0:1787136068.822635:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616444032 00000100:00100000:0.0:1787136068.822640:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616444032 00000100:00100000:0.0:1787136068.822661:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616444416 00000100:00100000:0.0:1787136068.822663:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616444416 00000100:00100000:0.0:1787136068.822680:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616444544 00000100:00100000:0.0:1787136068.822682:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616444544 00000100:00100000:0.0:1787136068.822705:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787136068.822712:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616444416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787136068.822765:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616444416:12345-0@lo:400:kworker.0 Request processed in 52us (2845us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136068.822771:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787136068.822787:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787136068.822793:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616444544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787136068.822821:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3300:x1873947616444544:12345-0@lo:400:kworker.0 Request processed in 28us (2855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136068.822826:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787136068.822837:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787136068.822840:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3299:x1873947616444032:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787136068.822854:0:15677:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 428 last 0 00000020:00000080:0.0:1787136068.822887:0:15677:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf5850c552f203695 00000004:00100000:0.0:1787136068.822901:0:15677:0:(mdt_handler.c:7490:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787136068.822926:0:15677:0:(import.c:65:import_set_state_nolock()) ffff8e974757e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787136068.822962:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3299:x1873947616444032:12345-0@lo:38:llog_process_th.0 Request processed in 120us (3647us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136068.822969:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787136068.822985:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787136068.823008:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9876bd1880 x1873947616444544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787136068.823020:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3300:1873947616444544:0@lo:400:kworker.0 00010000:00080000:0.0:1787136068.823030:0:3300:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e9876bd1f80 x1873947616444416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136084 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787136068.823039:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616444416:0@lo:400:kworker.0 00000040:00080000:3.0:1787136068.823674:0:15756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787136068.823872:0:15746:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787136068.823904:0:15746:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787136068.823927:0:15746:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511da800/0xf5850c552f203679 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203680 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.823939:0:15746:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98511da800/0xf5850c552f203679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203680 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787136068.823985:0:15746:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787136068.823987:0:15746:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787136068.823989:0:15746:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787136068.823990:0:15746:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787136068.823991:0:15746:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787136068.823993:0:15746:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787136068.823994:0:15746:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787136068.823997:0:15746:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787136068.823998:0:15746:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787136068.824002:0:15746:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1787136068.824005:0:15746:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787136068.824006:0:15746:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787136068.824007:0:15746:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787136068.824008:0:15746:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787136068.824009:0:15746:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787136068.824010:0:15746:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787136068.824011:0:15746:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787136068.824012:0:15746:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787136068.824013:0:15746:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787136068.824034:0:15746:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787136068.824076:0:15746:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616444672:0@lo:253:mount.lustre.0 00010000:00080000:1.0:1787136068.824286:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e974499dc00 x1873947616444032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787136078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787136068.824296:0:3299:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787136068.824303:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1787136068.824309:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787136068.824314:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787136068.824317:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e98456a2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787136068.824323:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3299:1873947616444032:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787136068.826957:0:15746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136068.827014:0:15746:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e986030e780 going to sleep for 11 seconds 00000100:00100000:3.0:1787136068.827742:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616444672 00000100:00100000:3.0:1787136068.827755:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616444672 00000100:00100000:3.0:1787136068.827800:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787136068.827810:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:15746:x1873947616444672:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787136068.827840:0:14338:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1787136068.827854:0:14338:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787136068.880168:0:14338:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787136068.880191:0:14338:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787136068.880560:0:14359:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787136068.880565:0:14359:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787136068.880585:0:14359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136068.880603:0:14359:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9876c9b200/0xf5850c552f20356f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203568 expref: 19 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136068.880611:0:14359:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136068.880671:0:14359:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9876c9b200/0xf5850c552f20356f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f203568 expref: 19 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136068.880686:0:14359:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e9876c9b200/0xf5850c552f20356f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f203568 expref: 19 pid: 14335 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136068.880701:0:14359:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14359:1873947616444800:0@lo:104: 00000100:00100000:3.0:1787136068.880761:0:14359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136068.880810:0:14359:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98502c4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787136068.880878:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616444800 00000100:00100000:2.0:1787136068.880886:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616444800 00000100:00100000:2.0:1787136068.880957:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787136068.880967:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:247d1cf6-e699-400d-82b2-f0faea63f3e6+3:14359:x1873947616444800:12345-0@lo:104: 00010000:00010000:2.0:1787136068.880980:0:14327:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20356f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881072:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787136068.881078:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:247d1cf6-e699-400d-82b2-f0faea63f3e6+3:14359:x1873947616444800:12345-0@lo:104: Request processed in 114us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136068.881085:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787136068.881107:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136068.881113:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f20356f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881120:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533af200 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:2.0:1787136068.881124:0:15684:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f20356f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881132:0:15684:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f20356f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787136068.881140:0:15684:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f20356f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787136068.881146:0:15684:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787136068.881188:0:15684:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20356f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881195:0:15684:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787136068.881215:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20356f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881233:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98533af200/0xf5850c552f203568 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f20356f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881247:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136068.881249:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136068.881251:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787136068.881264:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:247d1cf6-e699-400d-82b2-f0faea63f3e6:3302:1873947616444928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787136068.881294:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136068.881333:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616444928 00000100:00100000:2.0:1787136068.881338:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616444928 00010000:00010000:2.0:1787136068.881354:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9876c9b200/0xf5850c552f20356f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f203568 expref: 20 pid: 14335 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136068.881374:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787136068.881380:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:247d1cf6-e699-400d-82b2-f0faea63f3e6+20:3302:x1873947616444928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787136068.881388:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787136068.881393:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9876c9b200/0xf5850c552f20356f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f203568 expref: 20 pid: 14335 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881403:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9876c9b200/0xf5850c552f20356f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f203568 expref: 20 pid: 14335 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881418:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881427:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787136068.881438:0:14330:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012757268s 00010000:00010000:2.0:1787136068.881449:0:14330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881456:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881463:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881470:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881475:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cb600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136068.881479:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881486:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881495:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136068.881504:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787136068.881533:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:247d1cf6-e699-400d-82b2-f0faea63f3e6+20:3302:x1873947616444928:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136068.881541:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787136068.881587:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:247d1cf6-e699-400d-82b2-f0faea63f3e6:3302:1873947616444928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787136068.881850:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9876c9b200/0xf5850c552f20356f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f203568 expref: 19 pid: 14335 timeout: 528 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136068.881865:0:14359:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499c000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14359:1873947616444800:0@lo:104: 00010000:00010000:1.0:1787136068.881880:0:14359:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.881901:0:14359:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.881908:0:14359:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136068.881914:0:14359:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98413cb600/0xf5850c552f20369c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136068.898184:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:15746:x1873947616444672:12345-0@lo:253:mount.lustre.0 Request processed in 70367us (71225us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136068.898198:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787136068.898654:0:15746:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:247d1cf6-e699-400d-82b2-f0faea63f3e6:15746:1873947616444672:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787136068.898671:0:15746:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787136068.898674:0:15746:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787136068.898676:0:15746:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787136068.898677:0:15746:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787136068.898679:0:15746:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787136068.898680:0:15746:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787136068.898682:0:15746:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787136068.898684:0:15746:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787136068.898685:0:15746:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787136068.898687:0:15746:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787136068.898703:0:15746:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787136068.911186:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787136068.911491:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787136068.911707:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787136068.912960:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787136068.913165:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787136068.914669:0:15746:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787136068.917029:0:15746:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787136069.004819:0:15746:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787136069.004827:0:15746:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787136069.004865:0:15746:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787136069.004924:0:15746:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.138@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787136069.004945:0:15746:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787136069.004971:0:15746:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1787136069.213285:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136070.232375:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787136070.631658:0:14340:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787136070.631667:0:14340:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff8e9876a4d800 from 8 10000000:01000000:3.0:1787136070.631671:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787136070.632552:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413ca200/0xf5850c552f2036a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136070.632565:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98413ca200/0xf5850c552f2036a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136070.632577:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98413ca200/0xf5850c552f2036a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136070.632605:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616445056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787136070.632797:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136070.632948:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e986030e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787136070.632995:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616445056 00000100:00100000:1.0:1787136070.633003:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616445056 00000100:00100000:1.0:1787136070.633124:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787136070.633137:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:14340:x1873947616445056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787136070.633152:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136070.633169:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2036aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2036a3 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136070.633192:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2036aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2036a3 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136070.633202:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511dbe00/0xf5850c552f2036aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2036a3 expref: 19 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136070.633211:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dbe00, rc 0) 00000100:00100000:1.0:1787136070.633262:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:14340:x1873947616445056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136070.633270:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787136070.633366:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616445056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787136070.633380:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98413ca200/0xf5850c552f2036a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2036aa expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136070.633390:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98413ca200/0xf5850c552f2036a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f2036aa expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136070.633454:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616445184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787136070.633491:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136070.633518:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9849707cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787136070.633544:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616445184 00000100:00100000:1.0:1787136070.633548:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616445184 00000100:00100000:1.0:1787136070.633581:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787136070.633590:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:14340:x1873947616445184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787136070.633605:0:14338:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787136070.633622:0:14338:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787136070.633625:0:14338:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1787136070.633917:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:14340:x1873947616445184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 328us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136070.633925:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787136070.633959:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616445184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787136070.634013:0:14340:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787136070.634020:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98413ca200/0xf5850c552f2036a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2036aa expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136070.634029:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98413ca200/0xf5850c552f2036a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f2036aa expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136071.261516:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787136071.743446:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787136071.743463:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:2.0:1787136072.285017:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787136072.664265:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616445312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787136072.664340:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136072.664515:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616445312 00000100:00100000:0.0:1787136072.664533:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616445312 00000100:00100000:0.0:1787136072.664595:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787136072.664604:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616445312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787136072.664639:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787136072.664701:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787136072.670549:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616445312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5865us (6128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136072.670564:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787136072.670689:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1787136072.670718:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616445312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787136073.311390:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787136074.200295:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:247d1cf6-e699-400d-82b2-f0faea63f3e6:3300:1873947616445440:0@lo:400:kworker.0 00000100:00100000:0.0:1787136074.200373:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136074.201594:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787136074.201608:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616445568:0@lo:400:kworker.0 00000100:00100000:0.0:1787136074.201657:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136074.201699:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616445440 00000100:00100000:0.0:1787136074.201719:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616445440 00000100:00100000:0.0:1787136074.201765:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787136074.201774:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:3300:x1873947616445440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787136074.201820:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:3300:x1873947616445440:12345-0@lo:400:kworker.0 Request processed in 48us (1446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136074.201827:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787136074.201860:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616445568 00000100:00100000:0.0:1787136074.201864:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616445568 00000100:00100000:0.0:1787136074.201897:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787136074.201904:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616445568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787136074.201932:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616445568:12345-0@lo:400:kworker.0 Request processed in 29us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136074.201937:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787136074.201953:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787136074.201977:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616445568:0@lo:400:kworker.0 00000100:00100000:0.0:1787136074.201986:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:247d1cf6-e699-400d-82b2-f0faea63f3e6:3300:1873947616445440:0@lo:400:kworker.0 00000100:00080000:2.0:1787136074.210635:0:12897:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787136074.210645:0:12897:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787136074.210648:0:12897:0:(import.c:65:import_set_state_nolock()) ffff8e98496a4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787136074.210660:0:12897:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e98496a4800 using connection 192.168.203.138@tcp/0@lo 00000100:00100000:2.0:1787136074.210695:0:12897:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e9876bd3480 x1873947616445696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787136074.210756:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787136074.210771:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616446080:0@lo:400:kworker.0 00000100:00100000:2.0:1787136074.210834:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136074.210875:0:3299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616445696:0@lo:8:kworker.0 00000100:00100000:2.0:1787136074.210905:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136074.210932:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616445824:0@lo:400:kworker.0 00000100:00100000:2.0:1787136074.210966:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136074.210984:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787136074.210990:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616445952:0@lo:400:kworker.0 00000100:00100000:2.0:1787136074.211009:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136074.211039:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616446080 00000100:00100000:2.0:1787136074.211060:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616446080 00000100:00100000:2.0:1787136074.211107:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616445824 00000100:00100000:2.0:1787136074.211110:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616445824 00000100:00100000:2.0:1787136074.211121:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616445952 00000100:00100000:2.0:1787136074.211123:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616445952 00000100:00100000:2.0:1787136074.211136:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787136074.211143:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616446080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136074.211191:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1873947616446080:12345-0@lo:400:kworker.0 Request processed in 48us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136074.211197:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787136074.214396:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787136074.214415:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616445824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136074.214616:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787136074.214625:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616445952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136074.214677:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1873947616445952:12345-0@lo:400:kworker.0 Request processed in 54us (3666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136074.214684:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1787136074.214701:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787136074.214732:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd2d80 x1873947616445952/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787136074.214746:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3302:1873947616445952:0@lo:400:kworker.0 00010000:00080000:2.0:1787136074.214776:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd0700 x1873947616446080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787136074.214798:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3301:1873947616446080:0@lo:400:kworker.0 00000100:00100000:3.0:1787136074.214923:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1873947616445824:12345-0@lo:400:kworker.0 Request processed in 514us (3954us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136074.214936:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787136074.214965:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616445696 00000100:00100000:3.0:1787136074.214971:0:15030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616445696 00000100:00100000:3.0:1787136074.214992:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787136074.214997:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3299:x1873947616445696:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1787136074.215018:0:15030:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:3.0:1787136074.215044:0:15030:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf5850c552f2036b1 00002000:00100000:3.0:1787136074.215073:0:15030:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e9745a6b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113908 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787136074.215077:0:15030:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1787136074.215080:0:15030:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1787136074.216390:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd0a80 x1873947616445824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787136090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787136074.216406:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3302:1873947616445824:0@lo:400:kworker.0 00002000:00080000:3.0:1787136074.217074:0:15030:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787136074.217105:0:15030:0:(import.c:65:import_set_state_nolock()) ffff8e9745a6e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787136074.217185:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3299:x1873947616445696:12345-0@lo:8:kworker.0 Request processed in 2185us (6277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136074.217195:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1787136074.217676:0:3299:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e9876bd3480 x1873947616445696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787136099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787136074.217691:0:3299:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787136074.217699:0:3299:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787136074.217704:0:3299:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787136074.217706:0:3299:0:(import.c:65:import_set_state_nolock()) ffff8e98496a4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787136074.217720:0:3299:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787136074.217725:0:3299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3299:1873947616445696:0@lo:8:kworker.0 00000004:00080000:2.0:1787136074.217776:0:14368:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787136074.217795:0:14368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14368:1873947616446336:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787136074.217831:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136074.217852:0:14368:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843317000 going to sleep for 11 seconds 00000100:00100000:2.0:1787136074.217868:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616446336 00000100:00100000:2.0:1787136074.217873:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616446336 00000100:00100000:2.0:1787136074.217909:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787136074.217917:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14368:x1873947616446336:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787136074.219773:0:14367:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787136074.220203:0:14367:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 434163153710ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787136074.220230:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787136074.222421:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616446208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787136074.222625:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1787136074.227899:0:15027:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787136074.227909:0:15027:0:(ofd_dev.c:1643:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787136074.227916:0:15027:0:(ofd_dev.c:1494:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00080000:3.0:1787136074.229389:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1787136074.235792:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.235810:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2e5a625/0xf5850c552f2036b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.235826:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.235831:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.235837:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e5a625/0xf5850c552f2036b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.235853:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2e5a625/0xf5850c552f2036b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.235862:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2e5a625/0xf5850c552f2036b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.235870:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2e5a625/0xf5850c552f2036b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.235952:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787136074.236949:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616446208 00000100:00100000:2.0:1787136074.236961:0:15032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616446208 00000100:00100000:2.0:1787136074.237011:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787136074.237021:0:15032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1873947616446208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787136074.237080:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787136074.237170:0:15032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1873947616446208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (14545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136074.237178:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787136074.238547:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616446208:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787136074.239470:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787136074.239483:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2e5a625/0xf5850c552f2036b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.239496:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9b000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136074.239501:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2e5a625/0xf5850c552f2036b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.239520:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2e5a625/0xf5850c552f2036b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.239546:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2e5a625/0xf5850c552f2036b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.239554:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2e5a625/0xf5850c552f2036b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.239578:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136074.239580:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136074.239582:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136074.240085:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.240093:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f2036bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.240105:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.240109:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.240116:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f2036bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.240130:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f2036bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.240139:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f2036bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.240146:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f2036bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.240164:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787136074.240584:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787136074.240598:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f2036bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.240607:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9ac00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136074.240611:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f2036bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.240618:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f2036bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.240631:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f2036bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.240638:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f2036bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.240652:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136074.240653:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136074.240655:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136074.241101:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.241108:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f2036c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241118:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.241122:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.241127:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f2036c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241147:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f2036c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241155:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f2036c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241162:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f2036c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241177:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136074.241187:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136074.241192:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f2036c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241198:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9b600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136074.241201:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f2036c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241220:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f2036c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241232:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f2036c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241239:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f2036c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241332:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.241334:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.241336:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136074.241711:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.241717:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030495421/0xf5850c552f2036cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241725:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.241728:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.241733:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030495421/0xf5850c552f2036cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241742:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030495421/0xf5850c552f2036cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241749:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030495421/0xf5850c552f2036cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241756:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030495421/0xf5850c552f2036cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.241772:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787136074.242163:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.242169:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b309dec7/0xf5850c552f2036d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.242187:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.242190:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.242194:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b309dec7/0xf5850c552f2036d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.242204:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b309dec7/0xf5850c552f2036d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.242212:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b309dec7/0xf5850c552f2036d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.242219:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b309dec7/0xf5850c552f2036d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.242230:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787136074.242358:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787136074.242365:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030495421/0xf5850c552f2036cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.242372:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a200 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136074.242377:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030495421/0xf5850c552f2036cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.242397:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030495421/0xf5850c552f2036cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.242409:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030495421/0xf5850c552f2036cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.242417:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030495421/0xf5850c552f2036cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.242431:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787136074.242434:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b309dec7/0xf5850c552f2036d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.242440:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a800 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136074.242443:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b309dec7/0xf5850c552f2036d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.242450:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b309dec7/0xf5850c552f2036d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.242460:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b309dec7/0xf5850c552f2036d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.242467:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b309dec7/0xf5850c552f2036d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.242491:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136074.242493:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136074.242494:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136074.242501:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136074.242953:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.242959:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a54e3d/0xf5850c552f2036db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.242968:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.242971:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.242975:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011a54e3d/0xf5850c552f2036db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.242984:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011a54e3d/0xf5850c552f2036db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.243004:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011a54e3d/0xf5850c552f2036db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.243011:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011a54e3d/0xf5850c552f2036db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.243178:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787136074.243990:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.243997:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a16c4169/0xf5850c552f2036e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.244008:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.244012:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.244016:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a16c4169/0xf5850c552f2036e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.244026:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a16c4169/0xf5850c552f2036e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.244034:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a16c4169/0xf5850c552f2036e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.244041:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a16c4169/0xf5850c552f2036e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.244430:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787136074.244438:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011a54e3d/0xf5850c552f2036db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.244446:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9ba00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136074.244456:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a54e3d/0xf5850c552f2036db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.244466:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011a54e3d/0xf5850c552f2036db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.244486:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011a54e3d/0xf5850c552f2036db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.244494:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011a54e3d/0xf5850c552f2036db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.244537:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787136074.244542:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a16c4169/0xf5850c552f2036e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.244549:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9b400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136074.244552:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a16c4169/0xf5850c552f2036e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.244559:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a16c4169/0xf5850c552f2036e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.244569:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a16c4169/0xf5850c552f2036e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.244576:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.244583:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.244585:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.245035:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787136074.245043:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a16c4169/0xf5850c552f2036e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787136074.245939:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.245947:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfcae1b9/0xf5850c552f2036e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.245959:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.245963:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.245969:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfcae1b9/0xf5850c552f2036e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.245980:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfcae1b9/0xf5850c552f2036e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.245989:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dfcae1b9/0xf5850c552f2036e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.245996:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dfcae1b9/0xf5850c552f2036e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.246066:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787136074.246074:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dfcae1b9/0xf5850c552f2036e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.246082:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9aa00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136074.246086:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfcae1b9/0xf5850c552f2036e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.246095:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dfcae1b9/0xf5850c552f2036e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.246108:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dfcae1b9/0xf5850c552f2036e9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.246174:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.246177:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.246179:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.246367:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787136074.246373:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfcae1b9/0xf5850c552f2036e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787136074.246783:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.246789:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f2036f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.246799:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.246802:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.246807:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f2036f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.246817:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f2036f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.246824:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f2036f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.246831:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f2036f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.246865:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787136074.246870:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f2036f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.246877:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136074.246881:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f2036f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.246901:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f2036f0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.246913:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f2036f0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136074.246921:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136074.246922:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136074.246924:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.246994:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787136074.246999:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f2036f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787136074.247602:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.247609:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f2036f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.247628:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.247632:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.247636:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f2036f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.247647:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f2036f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.247655:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f2036f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.247662:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f2036f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.251369:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787136074.251383:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f2036f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.251397:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9ae00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136074.251402:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f2036f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.251413:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f2036f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.251434:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f2036f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.251443:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.251445:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.251447:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.251549:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787136074.251557:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f2036f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787136074.252069:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.252077:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f2036fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.252089:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.252093:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.252099:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f2036fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.252123:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f2036fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.252132:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f2036fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.252140:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f2036fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.252959:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787136074.252969:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f2036fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.252980:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9bc00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136074.252984:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f2036fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.253000:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f2036fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.253014:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f2036fe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.253023:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.253024:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.253026:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.253581:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787136074.253590:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f2036fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787136074.254165:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.254172:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203705 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.254184:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.254188:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.254194:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.254217:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.254240:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.254476:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.254580:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.254601:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787136074.255024:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.255030:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f20370c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.255041:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.255072:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.255078:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f20370c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.255090:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f20370c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.255097:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f20370c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.255104:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f20370c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.255134:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787136074.255145:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787136074.255150:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.255158:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136074.255163:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.255171:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203705 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.255186:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203705 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.255193:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203705 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.255210:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136074.255213:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f20370c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.255219:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9b200 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136074.255222:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f20370c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.255239:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f20370c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.255568:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787136074.256709:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787136074.256718:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdb9073a/0xf5850c552f203713 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.256730:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1787136074.256733:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787136074.256739:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdb9073a/0xf5850c552f203713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.256750:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdb9073a/0xf5850c552f203713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.256759:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdb9073a/0xf5850c552f203713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.256778:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdb9073a/0xf5850c552f203713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.256799:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787136074.256812:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787136074.256817:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdb9073a/0xf5850c552f203713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.256825:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98413cb600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136074.256829:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdb9073a/0xf5850c552f203713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.256838:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdb9073a/0xf5850c552f203713 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.256851:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdb9073a/0xf5850c552f203713 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.256859:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdb9073a/0xf5850c552f203713 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.256876:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.256878:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.256880:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.257445:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f20370c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.257456:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f20370c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.257477:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.257479:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.257480:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787136074.257774:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787136074.257789:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b81790e/0xf5850c552f20371a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.257799:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1787136074.257803:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787136074.257808:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b81790e/0xf5850c552f20371a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.257819:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b81790e/0xf5850c552f20371a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.257829:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b81790e/0xf5850c552f20371a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.257837:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b81790e/0xf5850c552f20371a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.257859:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787136074.258303:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787136074.258309:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaae956c/0xf5850c552f203721 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258318:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1787136074.258321:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787136074.258325:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eaae956c/0xf5850c552f203721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258334:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eaae956c/0xf5850c552f203721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258349:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eaae956c/0xf5850c552f203721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258356:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eaae956c/0xf5850c552f203721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258370:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787136074.258380:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787136074.258385:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b81790e/0xf5850c552f20371a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258392:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136074.258396:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b81790e/0xf5850c552f20371a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258404:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b81790e/0xf5850c552f20371a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258417:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b81790e/0xf5850c552f20371a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258425:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b81790e/0xf5850c552f20371a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258440:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787136074.258449:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eaae956c/0xf5850c552f203721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258457:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6a00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136074.258460:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaae956c/0xf5850c552f203721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258467:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eaae956c/0xf5850c552f203721 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258478:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eaae956c/0xf5850c552f203721 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258485:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eaae956c/0xf5850c552f203721 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258497:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.258499:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.258500:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787136074.258900:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787136074.258907:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb98c54/0xf5850c552f203728 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258916:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1787136074.258919:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787136074.258923:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb98c54/0xf5850c552f203728 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258944:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb98c54/0xf5850c552f203728 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258952:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb98c54/0xf5850c552f203728 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258958:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eb98c54/0xf5850c552f203728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.258970:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787136074.259399:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787136074.259405:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5bb9e03/0xf5850c552f20372f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.259413:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=434s v=(0 0) 00010000:00010000:3.0:1787136074.259416:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787136074.259420:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5bb9e03/0xf5850c552f20372f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.259429:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5bb9e03/0xf5850c552f20372f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.259438:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5bb9e03/0xf5850c552f20372f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.259457:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5bb9e03/0xf5850c552f20372f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.259474:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787136074.259484:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787136074.259489:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eb98c54/0xf5850c552f203728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.259496:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7e00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136074.259500:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb98c54/0xf5850c552f203728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.259728:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136074.259735:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5bb9e03/0xf5850c552f20372f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.259742:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136074.259745:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5bb9e03/0xf5850c552f20372f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.259754:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5bb9e03/0xf5850c552f20372f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.259766:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5bb9e03/0xf5850c552f20372f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.259784:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5bb9e03/0xf5850c552f20372f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.259798:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.259800:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.259802:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.259809:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136074.260673:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.260681:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f203736 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.260693:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.260697:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.260701:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f203736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.260712:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f203736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.260721:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f203736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.260729:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f203736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.260746:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136074.260761:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136074.260766:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f203736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.260773:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9b600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136074.260778:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f203736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.260786:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f203736 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.260799:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f203736 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.260806:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000ed46ae/0xf5850c552f203736 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.260823:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.260824:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.260826:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.261353:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb98c54/0xf5850c552f203728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.261373:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eb98c54/0xf5850c552f203728 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.261381:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb98c54/0xf5850c552f203728 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.261396:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.261398:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.261400:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136074.261593:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.261599:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4500017/0xf5850c552f20373d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.261609:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.261612:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.261616:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4500017/0xf5850c552f20373d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.261636:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4500017/0xf5850c552f20373d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.261645:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4500017/0xf5850c552f20373d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.261653:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4500017/0xf5850c552f20373d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.261668:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136074.261676:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136074.261681:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4500017/0xf5850c552f20373d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.261688:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9be00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136074.261692:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4500017/0xf5850c552f20373d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.261701:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4500017/0xf5850c552f20373d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.261711:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4500017/0xf5850c552f20373d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.261718:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4500017/0xf5850c552f20373d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.261736:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.261738:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.261740:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136074.262166:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.262172:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e3770a3/0xf5850c552f203744 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262181:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.262185:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.262189:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e3770a3/0xf5850c552f203744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262198:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e3770a3/0xf5850c552f203744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262218:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e3770a3/0xf5850c552f203744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262226:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e3770a3/0xf5850c552f203744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262239:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136074.262256:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136074.262260:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e3770a3/0xf5850c552f203744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262278:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136074.262282:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e3770a3/0xf5850c552f203744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262290:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e3770a3/0xf5850c552f203744 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262301:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e3770a3/0xf5850c552f203744 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262309:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e3770a3/0xf5850c552f203744 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262323:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.262325:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.262326:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136074.262733:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.262739:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f20374b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262748:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.262750:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.262754:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f20374b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262762:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f20374b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262776:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f20374b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262783:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f20374b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262802:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136074.262810:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136074.262815:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f20374b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262821:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9ac00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136074.262824:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f20374b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262831:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f20374b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262842:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f20374b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262850:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bde00ec8/0xf5850c552f20374b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.262863:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.262870:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.262872:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136074.263313:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.263319:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f203752 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.263328:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.263331:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.263336:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f203752 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.263344:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f203752 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.263352:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f203752 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.263358:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f203752 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.263371:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136074.263378:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136074.263383:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f203752 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.263388:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9b200 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136074.263391:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f203752 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.263410:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f203752 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.263421:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f203752 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.263428:0:14331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e808d7a/0xf5850c552f203752 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.263442:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.263444:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.263446:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136074.263995:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.264001:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203759 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264010:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.264013:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.264017:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264025:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264032:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264085:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264115:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787136074.264123:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787136074.264127:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264134:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136074.264137:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264145:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264156:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203759 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264163:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000228ff2c2/0xf5850c552f203759 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264175:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.264177:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.264179:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787136074.264828:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.264843:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f203760 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264853:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.264857:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.264862:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f203760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264870:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f203760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264879:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f203760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264886:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f203760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.264943:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787136074.265438:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.265444:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f203767 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.265454:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.265457:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.265461:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f203767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.265470:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f203767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.265486:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f203767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.265493:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f203767 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.266085:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787136074.266100:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f203760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.266110:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9bc00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136074.266114:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f203760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.266123:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f203760 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.266138:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f203760 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.266145:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f542c245/0xf5850c552f203760 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.266166:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787136074.266170:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f203767 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.266176:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9ae00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136074.266180:0:15684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f203767 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.266187:0:15684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f203767 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.266220:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f203767 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.266228:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.266230:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.266232:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.266648:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787136074.266656:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bc1b5bb/0xf5850c552f203767 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787136074.267221:0:15027:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787136074.267228:0:15027:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f20376e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.267238:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1787136074.267242:0:15027:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136074.267521:0:15027:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f20376e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.267534:0:15027:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f20376e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.267542:0:15027:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f20376e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136074.267562:0:15027:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f20376e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787136074.268071:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787136074.270902:0:14331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787136074.270917:0:14331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f20376e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.270932:0:14331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136074.270938:0:14331:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f20376e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.270949:0:14331:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f20376e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.270970:0:14331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f20376e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136074.270983:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.270985:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.270987:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136074.271012:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136074.271035:0:15027:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787136074.271042:0:15027:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b95b6321/0xf5850c552f20376e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15027 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787136074.271652:0:15027:0:(ofd_dev.c:1521:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1787136074.271750:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14368:x1873947616446336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 53829us (53914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136074.271760:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787136074.271813:0:14368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9876bd0a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14368:1873947616446336:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1787136074.271828:0:14368:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787136074.271882:0:14368:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14368:1873947616446464:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787136074.271923:0:14368:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136074.271973:0:14368:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9846145c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787136074.272016:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616446464 00000100:00100000:2.0:1787136074.272023:0:15030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616446464 00000100:00100000:2.0:1787136074.272184:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787136074.272193:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14368:x1873947616446464:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787136074.272237:0:15030:0:(ofd_dev.c:1750:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1787136074.281065:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14368:x1873947616446464:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8846us (9114us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787136074.281079:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787136074.281168:0:14368:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14368:1873947616446464:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787136074.281183:0:14368:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1787136074.328553:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787136074.586920:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1787136075.121772:0:16102:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg338-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787136075.356732:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787136076.377531:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787136077.279947:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136077.280153:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595481088 00000100:00100000:1.0:1787136077.280164:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595481088 00000100:00100000:1.0:1787136077.280214:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:1.0:1787136077.280223:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2358:x1873947595481088:12345-192.168.203.38@tcp:250:mount.lustre.0 00010000:00080000:1.0:1787136077.280250:0:14335:0:(ldlm_lib.c:1449:target_handle_connect()) MGS: connection from b60a4844-c244-49f5-a47a-c4b77f6694b7@192.168.203.38@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:1.0:1787136077.280277:0:14335:0:(genops.c:1406:class_connect()) connect: client b60a4844-c244-49f5-a47a-c4b77f6694b7, cookie 0xf5850c552f203775 00000100:00080000:1.0:1787136077.280414:0:14335:0:(import.c:65:import_set_state_nolock()) ffff8e9747592800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787136077.280484:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+5:2358:x1873947595481088:12345-192.168.203.38@tcp:250:mount.lustre.0 Request processed in 261us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136077.280503:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 75 00000100:00100000:0.0:1787136077.287610:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136077.287832:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595481216 00000100:00100000:1.0:1787136077.287968:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595481216 00000100:00100000:1.0:1787136077.288133:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:1.0:1787136077.288146:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+5:13736:x1873947595481216:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787136077.288162:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136077.288192:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511daa00/0xf5850c552f20377c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b7185c6 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136077.288221:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511daa00/0xf5850c552f20377c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185c6 expref: 6 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136077.288232:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511daa00/0xf5850c552f20377c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185c6 expref: 6 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136077.288241:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511daa00, rc 0) 00000100:00100000:1.0:1787136077.288305:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+6:13736:x1873947595481216:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 162us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136077.288313:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 76 00000100:00100000:2.0:1787136077.290368:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136077.290562:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595481344 00000100:00100000:1.0:1787136077.290572:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595481344 00000100:00100000:1.0:1787136077.290655:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:1.0:1787136077.290665:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+6:13736:x1873947595481344:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787136077.291502:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+6:13736:x1873947595481344:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 826us (1130us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787136077.291512:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 77 00000100:00100000:2.0:1787136077.299267:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136077.299422:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595481472 00000100:00100000:3.0:1787136077.299433:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595481472 00000100:00100000:3.0:1787136077.299505:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:3.0:1787136077.299516:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+6:13736:x1873947595481472:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787136077.299533:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136077.299551:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e987c2c6a00/0xf5850c552f203783 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b7185cd expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136077.299580:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e987c2c6a00/0xf5850c552f203783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185cd expref: 7 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136077.299592:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e987c2c6a00/0xf5850c552f203783 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185cd expref: 7 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136077.299601:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6a00, rc 0) 00000100:00100000:3.0:1787136077.299661:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+7:13736:x1873947595481472:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 148us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136077.299670:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 78 00000100:00100000:2.0:1787136077.301831:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136077.301922:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595481600 00000100:00100000:0.0:1787136077.301932:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595481600 00000100:00100000:0.0:1787136077.301988:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:0.0:1787136077.301998:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+7:13736:x1873947595481600:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787136077.302636:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+8:13736:x1873947595481600:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 638us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136077.302645:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 79 00000100:00100000:2.0:1787136077.312484:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136077.312665:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595481728 00000100:00100000:1.0:1787136077.312674:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595481728 00000100:00100000:1.0:1787136077.312729:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:1.0:1787136077.312740:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+8:13736:x1873947595481728:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787136077.313141:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+8:13736:x1873947595481728:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 401us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136077.313150:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 80 00000100:00100000:2.0:1787136077.322017:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136077.322512:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595481856 00000100:00100000:0.0:1787136077.322525:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595481856 00000100:00100000:0.0:1787136077.322573:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:0.0:1787136077.322582:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c7b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+8:13754:x1873947595481856:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787136077.322943:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c7b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+8:13754:x1873947595481856:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 360us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136077.322951:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 81 00000100:00100000:2.0:1787136077.340757:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136077.340857:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595481984 00000100:00100000:3.0:1787136077.340866:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595481984 00000100:00100000:3.0:1787136077.340922:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:3.0:1787136077.340938:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+8:13754:x1873947595481984:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787136077.341252:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+8:13754:x1873947595481984:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 314us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136077.341260:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 82 00000100:00100000:2.0:1787136077.354148:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136077.357417:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595482112 00000100:00100000:1.0:1787136077.357432:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595482112 00000100:00100000:1.0:1787136077.357557:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:1.0:1787136077.357567:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+8:13736:x1873947595482112:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787136077.357584:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136077.357601:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511db000/0xf5850c552f20378a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b7185f7 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136077.357629:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511db000/0xf5850c552f20378a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185f7 expref: 9 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136077.357639:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511db000/0xf5850c552f20378a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185f7 expref: 9 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136077.357648:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db000, rc 0) 00000100:00100000:1.0:1787136077.357715:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+9:13736:x1873947595482112:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 149us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136077.357723:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 83 00000100:00100000:2.0:1787136077.364352:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136077.364470:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595482240 00000100:00100000:0.0:1787136077.364480:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595482240 00000100:00100000:0.0:1787136077.364543:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:0.0:1787136077.364552:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+9:13736:x1873947595482240:12345-192.168.203.38@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787136077.364576:0:14337:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787136077.364598:0:14337:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787136077.364602:0:14337:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787136077.364605:0:14337:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787136077.364607:0:14337:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787136077.376029:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+9:13736:x1873947595482240:12345-192.168.203.38@tcp:256:mount.lustre.0 Request processed in 11461us (11971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136077.376044:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 84 00000100:00100000:2.0:1787136077.389017:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136077.389206:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595482368 00000100:00100000:1.0:1787136077.389217:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595482368 00000100:00100000:1.0:1787136077.389276:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:1.0:1787136077.389286:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+9:13736:x1873947595482368:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787136077.389301:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136077.389318:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511da000/0xf5850c552f203791 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b7185fe expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136077.389347:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511da000/0xf5850c552f203791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185fe expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136077.389376:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511da000/0xf5850c552f203791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185fe expref: 10 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136077.389385:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da000, rc 0) 00000100:00100000:1.0:1787136077.389450:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+10:13736:x1873947595482368:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 165us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136077.389457:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 85 00000100:00100000:2.0:1787136077.391547:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136077.391620:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595482496 00000100:00100000:0.0:1787136077.391628:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595482496 00000100:00100000:0.0:1787136077.391675:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:0.0:1787136077.391684:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+10:13736:x1873947595482496:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787136077.392263:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+10:13736:x1873947595482496:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 576us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136077.392272:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 86 00000100:00100000:0.0:1787136077.398516:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136077.398691:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595482624 00000100:00100000:3.0:1787136077.398702:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595482624 00000100:00100000:3.0:1787136077.398759:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 87 00000100:00100000:3.0:1787136077.398996:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+10:13736:x1873947595482624:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787136077.399685:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+10:13736:x1873947595482624:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 914us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136077.399696:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 87 00010000:00010000:0.0:1787136077.400510:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787136077.404603:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136077.406034:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595482752 00000100:00100000:1.0:1787136077.406124:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595482752 00000100:00100000:1.0:1787136077.406181:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:1.0:1787136077.406316:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+10:13758:x1873947595482752:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787136077.406736:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+10:13758:x1873947595482752:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 423us (2141us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136077.406744:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 88 00000100:00100000:0.0:1787136077.411624:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136077.412343:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595482880 00000100:00100000:3.0:1787136077.412354:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595482880 00000100:00100000:3.0:1787136077.412410:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:3.0:1787136077.412420:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+10:13758:x1873947595482880:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787136077.412689:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+10:13758:x1873947595482880:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 269us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136077.412697:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 89 00000100:00100000:3.0:1787136077.416425:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136077.423753:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595483008 00000100:00100000:2.0:1787136077.423769:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595483008 00000100:00100000:2.0:1787136077.423829:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:2.0:1787136077.423847:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1873947595483008:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787136077.423875:0:14344:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from 60a6a922-6d90-4897-b90a-1b9618ede7d7@192.168.203.38@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1787136077.423922:0:14344:0:(genops.c:1406:class_connect()) connect: client 60a6a922-6d90-4897-b90a-1b9618ede7d7, cookie 0xf5850c552f203798 00000004:00100000:2.0:1787136077.423949:0:14344:0:(mdt_handler.c:7486:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787136077.423956:0:14344:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787136077.458771:0:14344:0:(import.c:65:import_set_state_nolock()) ffff8e974647a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787136077.458864:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:2358:x1873947595483008:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 35016us (42449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136077.458876:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:2.0:1787136077.462453:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136077.462538:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595483264 00000100:00100000:3.0:1787136077.462547:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595483264 00000100:00080000:2.0:1787136077.462614:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787136077.462625:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:3.0:1787136077.462637:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:13736:x1873947595483264:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787136077.462681:0:14345:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787136077.462777:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:13736:x1873947595483264:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 134us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136077.462806:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:0.0:1787136077.464899:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136077.464995:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595483136 00000100:00100000:2.0:1787136077.465005:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595483136 00000100:00100000:2.0:1787136077.465085:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1787136077.465095:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:0:x1873947595483136:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787136077.465122:0:15677:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787136077.465193:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:0:x1873947595483136:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 100us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136077.465215:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:0.0:1787136077.469981:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136077.470074:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595483392 00000100:00100000:3.0:1787136077.470085:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595483392 00000100:00100000:3.0:1787136077.470166:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:3.0:1787136077.470177:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:13736:x1873947595483392:12345-192.168.203.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787136077.470268:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:13736:x1873947595483392:12345-192.168.203.38@tcp:40:mount.lustre.0 Request processed in 93us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136077.470276:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:3.0:1787136077.472971:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136077.473035:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595483520 00000100:00100000:2.0:1787136077.473045:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595483520 00000100:00100000:2.0:1787136077.473125:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1787136077.473133:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873947595483520:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787136077.473164:0:15027:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from 60a6a922-6d90-4897-b90a-1b9618ede7d7@192.168.203.38@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1787136077.473198:0:15027:0:(genops.c:1406:class_connect()) connect: client 60a6a922-6d90-4897-b90a-1b9618ede7d7, cookie 0xf5850c552f20379f 00002000:00100000:2.0:1787136077.473209:0:15027:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 60a6a922-6d90-4897-b90a-1b9618ede7d7/ffff8e974647b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113908 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787136077.473233:0:15027:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787136077.473799:0:15027:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787136077.473832:0:15027:0:(import.c:65:import_set_state_nolock()) ffff8e974647e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787136077.473949:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:2358:x1873947595483520:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 814us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136077.473959:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:1.0:1787136077.476109:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136077.476152:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136077.476252:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595483776 00000100:00100000:3.0:1787136077.476261:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595483776 00000100:00100000:3.0:1787136077.476310:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:3.0:1787136077.476321:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:13736:x1873947595483776:12345-192.168.203.38@tcp:33:mount.lustre.0 00000100:00100000:2.0:1787136077.476660:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595483648 00000100:00100000:2.0:1787136077.476665:0:15030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595483648 00000100:00100000:2.0:1787136077.476698:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:2.0:1787136077.476704:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1873947595483648:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787136077.476728:0:15030:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from 60a6a922-6d90-4897-b90a-1b9618ede7d7@192.168.203.38@tcp t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1787136077.476757:0:15030:0:(genops.c:1406:class_connect()) connect: client 60a6a922-6d90-4897-b90a-1b9618ede7d7, cookie 0xf5850c552f2037a6 00002000:00100000:2.0:1787136077.476768:0:15030:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 60a6a922-6d90-4897-b90a-1b9618ede7d7/ffff8e9746478000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113908 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787136077.476796:0:15030:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787136077.476974:0:15030:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787136077.477002:0:15030:0:(import.c:65:import_set_state_nolock()) ffff8e974647c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787136077.477100:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:2358:x1873947595483648:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 394us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136077.477108:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000004:00080000:2.0:1787136077.481958:0:14346:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 5568us 00000004:00200000:3.0:1787136077.495165:0:14346:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787136077.495356:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:13736:x1873947595483776:12345-192.168.203.38@tcp:33:mount.lustre.0 Request processed in 19033us (19198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136077.495367:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:1.0:1787136077.687334:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136077.687438:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595483904 00000100:00100000:2.0:1787136077.687448:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595483904 00000100:00100000:2.0:1787136077.687519:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1787136077.687530:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:13779:x1873947595483904:12345-192.168.203.38@tcp:101:mkdir.0 00010000:00010000:2.0:1787136077.687550:0:15677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787136077.687574:0:15677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2037ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718628 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136077.687639:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ae00/0xf5850c552f2037b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136077.687655:0:15677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ae00/0xf5850c552f2037b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136077.687672:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ae00/0xf5850c552f2037b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787136077.687900:0:15677:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787136077.687905:0:15677:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787136077.688002:0:15677:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ae00/0xf5850c552f2037b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136077.688031:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2037ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718628 expref: 8 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136077.688104:0:15677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ae00/0xf5850c552f2037b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718628 expref: 7 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136077.688120:0:15677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98820fc700) 00010000:00010000:2.0:1787136077.688123:0:15677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787136077.688126:0:15677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9876c9ae00, rc 0) 00000100:00100000:2.0:1787136077.688193:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+7:13779:x1873947595483904:12345-192.168.203.38@tcp:101:mkdir.0 Request processed in 665us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136077.688201:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:2.0:1787136077.786471:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616446592:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787136077.786552:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136077.786743:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616446592 00000100:00100000:3.0:1787136077.786751:0:15032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616446592 00000100:00100000:3.0:1787136077.786814:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787136077.786824:0:15032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616446592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787136077.786845:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787136077.786896:0:15032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616446592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136077.786904:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787136077.786983:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616446592:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787136077.787230:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787136078.431537:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787136079.322867:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:247d1cf6-e699-400d-82b2-f0faea63f3e6:3303:1873947616446720:0@lo:400:kworker.0 00000100:00100000:1.0:1787136079.322948:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136079.322997:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616447232:0@lo:400:kworker.0 00000100:00100000:1.0:1787136079.323747:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136079.323794:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787136079.323803:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616447104:0@lo:400:kworker.0 00000100:00100000:1.0:1787136079.323831:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136079.323877:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616446720 00000100:00100000:1.0:1787136079.323884:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616446720 00000100:00100000:1.0:1787136079.323941:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787136079.323951:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:3303:x1873947616446720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787136079.323999:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:3303:x1873947616446720:12345-0@lo:400:kworker.0 Request processed in 49us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136079.324007:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787136079.325552:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:247d1cf6-e699-400d-82b2-f0faea63f3e6:3303:1873947616446720:0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.326079:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616446848:0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.326135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136079.326162:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616447360:0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.326198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136079.326219:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787136079.326226:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9881fa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616446976:0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.326245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136079.326260:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616447488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787136079.326280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136079.326308:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616446848 00000100:00100000:2.0:1787136079.326315:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616446848 00000100:00100000:2.0:1787136079.326358:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616446976 00000100:00100000:2.0:1787136079.326361:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616446976 00000100:00100000:2.0:1787136079.326378:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787136079.326386:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616446848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.326431:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616446848:12345-0@lo:400:kworker.0 Request processed in 45us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136079.326449:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787136079.326464:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787136079.326469:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1873947616446976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.326512:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3300:x1873947616446976:12345-0@lo:400:kworker.0 Request processed in 42us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136079.326518:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787136079.326536:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616447488 00000100:00100000:2.0:1787136079.326539:0:15032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616447488 00000100:00100000:2.0:1787136079.326562:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787136079.326568:0:15032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1873947616447488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787136079.326592:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787136079.326620:0:15032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3300:x1873947616447488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136079.326626:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787136079.328532:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787136079.328540:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787136079.328595:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616446976:0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.328616:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616447488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787136079.328627:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616446848:0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.328662:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616447232 00000100:00100000:2.0:1787136079.328667:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616447232 00000100:00100000:2.0:1787136079.328718:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616447104 00000100:00100000:2.0:1787136079.328722:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616447104 00000100:00100000:2.0:1787136079.328732:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616447360 00000100:00100000:2.0:1787136079.328735:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616447360 00000100:00100000:2.0:1787136079.328748:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787136079.328763:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616447232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.328836:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616447232:12345-0@lo:400:kworker.0 Request processed in 74us (5091us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136079.328843:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787136079.328859:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787136079.328865:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616447104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.328892:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616447104:12345-0@lo:400:kworker.0 Request processed in 28us (5060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136079.328898:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787136079.328907:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787136079.328913:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616447360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.328944:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616447360:12345-0@lo:400:kworker.0 Request processed in 31us (2745us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136079.328949:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1787136079.328961:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787136079.328986:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616447104:0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.328998:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616447232:0@lo:400:kworker.0 00000100:00100000:2.0:1787136079.329023:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9881fa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616447360:0@lo:400:kworker.0 00010000:00010000:2.0:1787136079.448380:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787136079.449327:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 60a6a922-6d90-4897-b90a-1b9618ede7d7 00000001:00080000:1.0:1787136079.449342:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1787136079.449396:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1787136079.754270:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136079.754360:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595484032 00000100:00100000:2.0:1787136079.754371:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595484032 00000100:00100000:2.0:1787136079.754448:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:2.0:1787136079.754458:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+7:13831:x1873947595484032:12345-192.168.203.38@tcp:41:lfs.0 00000004:00000024:2.0:1787136079.754511:0:15677:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787136079.754629:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+7:13831:x1873947595484032:12345-192.168.203.38@tcp:41:lfs.0 Request processed in 172us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136079.754637:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00080000:0.0:1787136079.754765:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787136079.759725:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136079.759878:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595484160 00000100:00100000:2.0:1787136079.759888:0:15032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595484160 00000100:00100000:2.0:1787136079.759965:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1787136079.759976:0:15032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:13831:x1873947595484160:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1787136079.760013:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787136079.760129:0:15032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:13831:x1873947595484160:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 155us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136079.760137:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00080000:0.0:1787136079.760328:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787136079.763404:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136079.763510:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595484288 00000100:00100000:2.0:1787136079.763519:0:15032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595484288 00000100:00100000:2.0:1787136079.763587:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1787136079.763598:0:15032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:60a6a922-6d90-4897-b90a-1b9618ede7d7+5:13831:x1873947595484288:12345-192.168.203.38@tcp:13:lfs.0 00002000:00000024:2.0:1787136079.763620:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787136079.763717:0:15032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:60a6a922-6d90-4897-b90a-1b9618ede7d7+5:13831:x1873947595484288:12345-192.168.203.38@tcp:13:lfs.0 Request processed in 121us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136079.763726:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00080000:0.0:1787136079.764028:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787136080.008514:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136080.008673:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595484416 00000100:00100000:0.0:1787136080.008682:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595484416 00000100:00100000:0.0:1787136080.008744:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:0.0:1787136080.008755:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+10:13863:x1873947595484416:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787136080.008771:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787136080.008788:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9874896600/0xf5850c552f2037bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b71862f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136080.008828:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9874896600/0xf5850c552f2037bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71862f expref: 11 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136080.008841:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9874896600/0xf5850c552f2037bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71862f expref: 11 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136080.008850:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896600, rc 0) 00000100:00100000:0.0:1787136080.008967:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+11:13863:x1873947595484416:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 213us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136080.008974:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 91 00000100:00100000:1.0:1787136080.030896:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136080.030981:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595484544 00000100:00100000:2.0:1787136080.030991:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595484544 00000100:00100000:2.0:1787136080.031085:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:2.0:1787136080.031095:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+11:13863:x1873947595484544:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787136080.031369:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+11:13863:x1873947595484544:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 274us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136080.031377:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 92 00000100:00100000:2.0:1787136080.034327:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136080.034425:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595484672 00000100:00100000:1.0:1787136080.034435:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595484672 00000100:00100000:1.0:1787136080.034493:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:1.0:1787136080.034503:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+11:13863:x1873947595484672:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787136080.034759:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+11:13863:x1873947595484672:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 256us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136080.034767:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 93 00000100:00100000:1.0:1787136080.037976:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136080.038289:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595484800 00000100:00100000:0.0:1787136080.038299:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595484800 00000100:00100000:0.0:1787136080.038353:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:0.0:1787136080.038363:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+11:13870:x1873947595484800:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787136080.038648:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+11:13870:x1873947595484800:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 286us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136080.038657:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 94 00000100:00100000:0.0:1787136080.065885:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136080.068184:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595484928 00000100:00100000:2.0:1787136080.068200:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595484928 00000100:00100000:2.0:1787136080.068271:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:2.0:1787136080.068281:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+11:13870:x1873947595484928:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787136080.068566:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+11:13870:x1873947595484928:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 285us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136080.068575:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 95 00000100:00100000:2.0:1787136080.084587:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136080.084725:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595485056 00000100:00100000:1.0:1787136080.084735:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595485056 00000100:00100000:1.0:1787136080.084791:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:1.0:1787136080.084801:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+11:13863:x1873947595485056:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787136080.084843:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136080.084864:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511db600/0xf5850c552f2037c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b718659 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136080.084891:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511db600/0xf5850c552f2037c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718659 expref: 12 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136080.084902:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511db600/0xf5850c552f2037c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718659 expref: 12 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136080.084912:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db600, rc 0) 00000100:00100000:1.0:1787136080.084975:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+12:13863:x1873947595485056:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 174us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136080.084982:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 96 00000100:00100000:1.0:1787136080.092297:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136080.092397:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595485184 00000100:00100000:0.0:1787136080.092408:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595485184 00000100:00100000:0.0:1787136080.092462:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:0.0:1787136080.092483:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98736dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+12:13863:x1873947595485184:12345-192.168.203.38@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787136080.092512:0:14337:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787136080.092537:0:14337:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787136080.092541:0:14337:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787136080.092544:0:14337:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787136080.092546:0:14337:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1787136080.094600:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98736dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+12:13863:x1873947595485184:12345-192.168.203.38@tcp:256:mount.lustre.0 Request processed in 2118us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136080.094613:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 97 00000100:00100000:2.0:1787136080.099507:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136080.099599:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595485312 00000100:00100000:1.0:1787136080.099608:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595485312 00000100:00100000:1.0:1787136080.099660:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:1.0:1787136080.099671:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+12:13863:x1873947595485312:12345-192.168.203.38@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787136080.099687:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136080.099704:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511da200/0xf5850c552f2037c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b718660 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136080.099730:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511da200/0xf5850c552f2037c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718660 expref: 13 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136080.099758:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511da200/0xf5850c552f2037c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718660 expref: 13 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136080.099767:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da200, rc 0) 00000100:00100000:1.0:1787136080.099889:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13863:x1873947595485312:12345-192.168.203.38@tcp:101:mount.lustre.0 Request processed in 219us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136080.099896:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 98 00000100:00100000:0.0:1787136080.106616:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136080.106929:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595485440 00000100:00100000:1.0:1787136080.106939:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595485440 00000100:00100000:1.0:1787136080.106998:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:1.0:1787136080.107007:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13863:x1873947595485440:12345-192.168.203.38@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787136080.107488:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13863:x1873947595485440:12345-192.168.203.38@tcp:501:mount.lustre.0 Request processed in 480us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136080.107497:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 99 00000100:00100000:0.0:1787136080.109449:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136080.109725:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595485568 00000100:00100000:3.0:1787136080.109735:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595485568 00000100:00100000:3.0:1787136080.109787:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:3.0:1787136080.109796:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13863:x1873947595485568:12345-192.168.203.38@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787136080.110001:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13863:x1873947595485568:12345-192.168.203.38@tcp:503:mount.lustre.0 Request processed in 205us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136080.110009:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 100 00000100:00100000:3.0:1787136080.118799:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136080.119978:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595485696 00000100:00100000:1.0:1787136080.119990:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595485696 00000100:00100000:1.0:1787136080.120082:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:1.0:1787136080.120092:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13875:x1873947595485696:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787136080.120348:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13875:x1873947595485696:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 257us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136080.120356:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 101 00000100:00100000:0.0:1787136080.134630:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136080.135414:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595485824 00000100:00100000:1.0:1787136080.135426:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595485824 00000100:00100000:1.0:1787136080.135498:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:1.0:1787136080.135508:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13875:x1873947595485824:12345-192.168.203.38@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787136080.135791:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13875:x1873947595485824:12345-192.168.203.38@tcp:502:llog_process_th.0 Request processed in 283us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136080.135799:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 102 00000100:00100000:0.0:1787136080.148194:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136080.148727:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595485952 00000100:00100000:1.0:1787136080.148740:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595485952 00000100:00100000:1.0:1787136080.148787:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1787136080.148796:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1873947595485952:12345-192.168.203.38@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787136080.148832:0:14344:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-MDT0000: connection from 6da5b72c-7294-4368-981d-7e3e213210e1@192.168.203.38@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:1.0:1787136080.148865:0:14344:0:(genops.c:1406:class_connect()) connect: client 6da5b72c-7294-4368-981d-7e3e213210e1, cookie 0xf5850c552f2037d0 00000004:00100000:1.0:1787136080.148894:0:14344:0:(mdt_handler.c:7486:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787136080.149004:0:14344:0:(import.c:65:import_set_state_nolock()) ffff8e9747591800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787136080.149443:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da5b72c-7294-4368-981d-7e3e213210e1+6:2358:x1873947595485952:12345-192.168.203.38@tcp:38:mount.lustre.0 Request processed in 646us (1256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136080.149451:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1787136080.154488:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136080.154765:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595486208 00000100:00100000:3.0:1787136080.154775:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595486208 00000100:00100000:3.0:1787136080.154861:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:3.0:1787136080.154873:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da5b72c-7294-4368-981d-7e3e213210e1+6:13863:x1873947595486208:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787136080.154914:0:14343:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787136080.154986:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da5b72c-7294-4368-981d-7e3e213210e1+6:13863:x1873947595486208:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 115us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136080.154993:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00080000:0.0:1787136080.155153:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787136080.161036:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136080.161160:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595486080 00000100:00100000:1.0:1787136080.161180:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595486080 00000100:00100000:1.0:1787136080.161237:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:1.0:1787136080.161247:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da5b72c-7294-4368-981d-7e3e213210e1+6:0:x1873947595486080:12345-192.168.203.38@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787136080.161277:0:14344:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787136080.161359:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da5b72c-7294-4368-981d-7e3e213210e1+6:0:x1873947595486080:12345-192.168.203.38@tcp:41:mount.lustre.0 Request processed in 114us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136080.161367:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:1.0:1787136080.162865:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136080.162930:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595486336 00000100:00100000:3.0:1787136080.162937:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595486336 00000100:00100000:3.0:1787136080.162980:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:3.0:1787136080.162988:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da5b72c-7294-4368-981d-7e3e213210e1+6:13863:x1873947595486336:12345-192.168.203.38@tcp:40:mount.lustre.0 00000100:00100000:3.0:1787136080.163098:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da5b72c-7294-4368-981d-7e3e213210e1+6:13863:x1873947595486336:12345-192.168.203.38@tcp:40:mount.lustre.0 Request processed in 111us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136080.163106:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:3.0:1787136080.173992:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136080.174145:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136080.174255:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136080.174319:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595486720 00000100:00100000:0.0:1787136080.174333:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595486720 00000100:00100000:0.0:1787136080.174384:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:0.0:1787136080.174393:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da5b72c-7294-4368-981d-7e3e213210e1+6:13863:x1873947595486720:12345-192.168.203.38@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787136080.174649:0:14347:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787136080.174789:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da5b72c-7294-4368-981d-7e3e213210e1+6:13863:x1873947595486720:12345-192.168.203.38@tcp:33:mount.lustre.0 Request processed in 396us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136080.174798:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:2.0:1787136080.180020:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595486464 00000100:00100000:2.0:1787136080.180042:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595486464 00000100:00100000:2.0:1787136080.180102:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595486592 00000100:00100000:2.0:1787136080.180105:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595486592 00000100:00100000:2.0:1787136080.180122:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1787136080.180130:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873947595486464:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787136080.180159:0:15027:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0000: connection from 6da5b72c-7294-4368-981d-7e3e213210e1@192.168.203.38@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1787136080.180198:0:15027:0:(genops.c:1406:class_connect()) connect: client 6da5b72c-7294-4368-981d-7e3e213210e1, cookie 0xf5850c552f2037d7 00002000:00100000:2.0:1787136080.180804:0:15027:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6da5b72c-7294-4368-981d-7e3e213210e1/ffff8e987c2fb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113908 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787136080.180885:0:15027:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787136080.181003:0:15027:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787136080.181036:0:15027:0:(import.c:65:import_set_state_nolock()) ffff8e987c2fa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787136080.181195:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da5b72c-7294-4368-981d-7e3e213210e1+6:2358:x1873947595486464:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 1062us (7145us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136080.181212:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:2.0:1787136080.181251:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:2.0:1787136080.181256:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1873947595486592:12345-192.168.203.38@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787136080.181276:0:15027:0:(ldlm_lib.c:1449:target_handle_connect()) lustre-OST0001: connection from 6da5b72c-7294-4368-981d-7e3e213210e1@192.168.203.38@tcp t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1787136080.181297:0:15027:0:(genops.c:1406:class_connect()) connect: client 6da5b72c-7294-4368-981d-7e3e213210e1, cookie 0xf5850c552f2037de 00002000:00100000:2.0:1787136080.181304:0:15027:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6da5b72c-7294-4368-981d-7e3e213210e1/ffff8e987c2ff000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113908 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787136080.181309:0:15027:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787136080.181883:0:15027:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787136080.181905:0:15027:0:(import.c:65:import_set_state_nolock()) ffff8e987c2fd800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787136080.181942:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da5b72c-7294-4368-981d-7e3e213210e1+6:2358:x1873947595486592:12345-192.168.203.38@tcp:8:mount.lustre.0 Request processed in 680us (7683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136080.181950:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:0.0:1787136080.378748:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136080.378904:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595486848 00000100:00100000:1.0:1787136080.378914:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595486848 00000100:00100000:1.0:1787136080.378987:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:1.0:1787136080.378997:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da5b72c-7294-4368-981d-7e3e213210e1+6:13896:x1873947595486848:12345-192.168.203.38@tcp:101:mkdir.0 00010000:00010000:1.0:1787136080.379017:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136080.379039:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da400/0xf5850c552f2037e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71868a expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136080.379127:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2037ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136080.379142:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2037ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136080.379155:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2037ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787136080.379351:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787136080.379355:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787136080.379436:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2037ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136080.379487:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da400/0xf5850c552f2037e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71868a expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136080.379506:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2037ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71868a expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136080.379515:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98820fc700) 00010000:00010000:1.0:1787136080.379518:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787136080.379522:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db200, rc 0) 00000100:00100000:1.0:1787136080.379587:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da5b72c-7294-4368-981d-7e3e213210e1+7:13896:x1873947595486848:12345-192.168.203.38@tcp:101:mkdir.0 Request processed in 591us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136080.379601:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00010000:00010000:0.0:1787136080.474731:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136081.498751:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787136081.902793:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6da5b72c-7294-4368-981d-7e3e213210e1 00000001:00100000:3.0:1787136081.902806:0:6697:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 60a6a922-6d90-4897-b90a-1b9618ede7d7 00010000:00010000:2.0:1787136082.521416:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787136082.907995:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787136082.908019:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616447616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787136082.908107:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136082.908713:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616447616 00000100:00100000:3.0:1787136082.908723:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616447616 00000100:00100000:3.0:1787136082.908783:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787136082.908793:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616447616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787136082.908837:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787136082.908899:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616447616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136082.908907:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787136082.908928:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787136082.908960:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616447616:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1787136082.971641:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6da5b72c-7294-4368-981d-7e3e213210e1 00000001:00100000:0.0:1787136082.971656:0:5844:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 60a6a922-6d90-4897-b90a-1b9618ede7d7 00000001:02000400:0.0:1787136083.015953:0:16309:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1787136083.544335:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787136084.441183:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787136084.441205:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616447744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787136084.441268:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136084.441324:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616447744 00000100:00100000:0.0:1787136084.441330:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616447744 00000100:00100000:0.0:1787136084.441376:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787136084.441384:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616447744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787136084.441414:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787136084.441469:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616447744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136084.441476:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787136084.441498:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787136084.441524:0:3302:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787136084.441552:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616447744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787136084.447359:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616448000:0@lo:400:kworker.0 00000100:00100000:2.0:1787136084.447426:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136084.447731:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:247d1cf6-e699-400d-82b2-f0faea63f3e6:3300:1873947616447872:0@lo:400:kworker.0 00000100:00100000:1.0:1787136084.447769:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136084.447803:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616448384:0@lo:400:kworker.0 00000100:00100000:1.0:1787136084.447829:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136084.447866:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616448384 00000100:00100000:1.0:1787136084.447873:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616448384 00000100:00100000:1.0:1787136084.447924:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787136084.447933:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616448384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787136084.447983:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3300:x1873947616448384:12345-0@lo:400:kworker.0 Request processed in 51us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136084.447990:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787136084.454413:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616448000 00000100:00100000:0.0:1787136084.454431:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616448000 00000100:00100000:0.0:1787136084.455983:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787136084.455997:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616448000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787136084.456100:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616448000:12345-0@lo:400:kworker.0 Request processed in 107us (8674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136084.456108:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787136084.457251:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787136084.457259:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787136084.459362:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616448256:0@lo:400:kworker.0 00000100:00100000:2.0:1787136084.459438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136084.459495:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787136084.459503:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616448128:0@lo:400:kworker.0 00000100:00100000:2.0:1787136084.459526:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136084.459577:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616447872 00000100:00100000:2.0:1787136084.459585:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616447872 00000100:00100000:0.0:1787136084.459617:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616448256 00000100:00100000:0.0:1787136084.459621:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616448256 00000100:00100000:2.0:1787136084.459644:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787136084.459653:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616448128 00000100:00100000:0.0:1787136084.459655:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616448128 00000100:00100000:2.0:1787136084.459663:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:3300:x1873947616447872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787136084.459667:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787136084.459673:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616448256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136084.459710:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:3300:x1873947616447872:12345-0@lo:400:kworker.0 Request processed in 48us (11940us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136084.459712:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1873947616448256:12345-0@lo:400:kworker.0 Request processed in 40us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136084.459718:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787136084.459718:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787136084.459736:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787136084.459741:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616448128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787136084.459781:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1873947616448128:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136084.459793:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787136084.459826:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3303:1873947616448128:0@lo:400:kworker.0 00000100:00100000:0.0:1787136084.459837:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3303:1873947616448256:0@lo:400:kworker.0 00000100:00100000:2.0:1787136084.459849:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616448000:0@lo:400:kworker.0 00000100:00080000:0.0:1787136084.459866:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787136084.459896:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:247d1cf6-e699-400d-82b2-f0faea63f3e6:3300:1873947616447872:0@lo:400:kworker.0 00000100:00100000:2.0:1787136084.459908:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3300:1873947616448384:0@lo:400:kworker.0 00000001:00100000:1.0:1787136084.515458:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6da5b72c-7294-4368-981d-7e3e213210e1 00010000:00010000:3.0:1787136084.570311:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787136084.824758:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787136085.352895:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136085.352926:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136085.352945:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136085.352966:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136085.352991:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136085.353006:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136085.353025:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136085.353057:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595487232 00000100:00100000:1.0:1787136085.353066:0:15030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595487232 00000100:00100000:1.0:1787136085.353106:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595487744 00000100:00100000:1.0:1787136085.353108:0:15030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595487744 00000100:00100000:1.0:1787136085.353118:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595487360 00000100:00100000:1.0:1787136085.353120:0:15030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595487360 00000100:00100000:1.0:1787136085.353129:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595487616 00000100:00100000:1.0:1787136085.353137:0:15030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595487616 00000100:00100000:1.0:1787136085.353153:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1787136085.353161:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+5:2360:x1873947595487232:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787136085.353219:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+5:2360:x1873947595487232:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 59us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136085.353228:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1787136085.353243:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:1.0:1787136085.353248:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6da5b72c-7294-4368-981d-7e3e213210e1+5:2360:x1873947595487744:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787136085.353266:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6da5b72c-7294-4368-981d-7e3e213210e1+5:2360:x1873947595487744:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 18us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136085.353271:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:1.0:1787136085.353279:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1787136085.353284:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+5:2360:x1873947595487360:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787136085.353299:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+5:2360:x1873947595487360:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 15us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136085.353304:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1787136085.353312:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:1.0:1787136085.353316:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6da5b72c-7294-4368-981d-7e3e213210e1+5:2360:x1873947595487616:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787136085.353334:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6da5b72c-7294-4368-981d-7e3e213210e1+5:2360:x1873947595487616:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 18us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136085.353340:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:1.0:1787136085.353356:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595487488 00000100:00100000:1.0:1787136085.353359:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595487488 00000100:00100000:1.0:1787136085.353380:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595487104 00000100:00100000:1.0:1787136085.353387:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595487104 00000100:00100000:1.0:1787136085.353405:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:1.0:1787136085.353410:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da5b72c-7294-4368-981d-7e3e213210e1+6:2360:x1873947595487488:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787136085.353444:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da5b72c-7294-4368-981d-7e3e213210e1+6:2360:x1873947595487488:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 34us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136085.353451:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:1.0:1787136085.353461:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:1.0:1787136085.353467:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:2360:x1873947595487104:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787136085.353485:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:2360:x1873947595487104:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 18us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136085.353490:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:3.0:1787136085.353843:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595486976 00000100:00100000:3.0:1787136085.353848:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595486976 00000100:00100000:3.0:1787136085.353884:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00100000:3.0:1787136085.353890:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:2360:x1873947595486976:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:3.0:1787136085.353918:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:2360:x1873947595486976:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 29us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136085.353924:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 104 00000100:00080000:0.0:1787136085.357459:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787136085.357469:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787136085.357472:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787136085.592633:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787136086.279462:0:16457:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf8cadc60 20000000:00000080:1.0:1787136086.279478:0:16457:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e97450b5000 uarg=0000000000000000 20000000:01000000:1.0:1787136086.282225:0:16457:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787136086.282233:0:16457:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787136086.282238:0:16457:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787136086.284196:0:16458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787136086.284566:0:16457:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787136086.291259:0:16457:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787136086.291291:0:16457:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136086.291310:0:16457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98533af800/0xf5850c552f2034ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2034e3 expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136086.291317:0:16457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98820e3a00/0xf5850c552f203537 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203530 expref: 18 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136086.291324:0:16457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e9876c9b800/0xf5850c552f203672 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f20366b expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136086.291349:0:16457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98511da000/0xf5850c552f203791 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185fe expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136086.291356:0:16457:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e98511da200/0xf5850c552f2037c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718660 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136086.291363:0:16457:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136086.291405:0:16457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98511da200/0xf5850c552f2037c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718660 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136086.291420:0:16457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e98511da200/0xf5850c552f2037c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718660 expref: 12 pid: 14338 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136086.291445:0:16457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1873947616448512:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787136086.291548:0:16457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98511da000/0xf5850c552f203791 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185fe expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136086.291556:0:16457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e98511da000/0xf5850c552f203791 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185fe expref: 12 pid: 14338 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136086.291564:0:16457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1873947616448640:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787136086.291594:0:16457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e9876c9b800/0xf5850c552f203672 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f20366b expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136086.291602:0:16457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e9876c9b800/0xf5850c552f203672 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f20366b expref: 18 pid: 14337 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136086.291625:0:16457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1873947616448768:0@lo:104: 00000100:00100000:1.0:1787136086.291666:0:16457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787136086.291995:0:16457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98820e3a00/0xf5850c552f203537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f203530 expref: 18 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136086.292005:0:16457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e98820e3a00/0xf5850c552f203537 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f203530 expref: 18 pid: 14335 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136086.292013:0:16457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1873947616448896:0@lo:104: 00000100:00100000:1.0:1787136086.292035:0:16457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787136086.292424:0:16457:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e98533af800/0xf5850c552f2034ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf5850c552f2034e3 expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136086.292442:0:16457:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e98533af800/0xf5850c552f2034ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf5850c552f2034e3 expref: 18 pid: 14337 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136086.292451:0:16457:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1873947616449024:0@lo:104: 00000100:00100000:1.0:1787136086.292476:0:16457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136086.293961:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616448768 00000100:00100000:3.0:1787136086.293972:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616448768 00000100:00100000:3.0:1787136086.296981:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616448896 00000100:00100000:3.0:1787136086.296996:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616448896 00000100:00100000:3.0:1787136086.297021:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787136086.297069:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:247d1cf6-e699-400d-82b2-f0faea63f3e6+4:16457:x1873947616448768:12345-0@lo:104: 00010000:00010000:3.0:1787136086.297090:0:14326:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f203672 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.297416:0:14326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787136086.297422:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:247d1cf6-e699-400d-82b2-f0faea63f3e6+4:16457:x1873947616448768:12345-0@lo:104: Request processed in 379us (5757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136086.297442:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787136086.297460:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787136086.297466:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:247d1cf6-e699-400d-82b2-f0faea63f3e6+3:16457:x1873947616448896:12345-0@lo:104: 00010000:00010000:3.0:1787136086.297474:0:14326:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f203537 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298248:0:14326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787136086.298259:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:247d1cf6-e699-400d-82b2-f0faea63f3e6+3:16457:x1873947616448896:12345-0@lo:104: Request processed in 791us (6221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136086.298267:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787136086.298295:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787136086.298302:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f203672 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298311:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511dae00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:3.0:1787136086.298314:0:15684:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f203672 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298325:0:15684:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f203672 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787136086.298333:0:15684:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f203672 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787136086.298357:0:15684:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787136086.298401:0:15684:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f203672 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298408:0:15684:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787136086.298443:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f203672 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298450:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98511dae00/0xf5850c552f20366b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f203672 expref: -99 pid: 15746 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298463:0:15684:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787136086.298466:0:15684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f203537 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298473:0:15684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afa00 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:3.0:1787136086.298476:0:15684:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f203537 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298482:0:15684:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f203537 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787136086.298489:0:15684:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f203537 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787136086.298494:0:15684:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787136086.298507:0:15684:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f203537 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298513:0:15684:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787136086.298535:0:15684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f203537 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298542:0:15684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98533afa00/0xf5850c552f203530 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f203537 expref: -99 pid: 15026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298553:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136086.298555:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136086.298557:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787136086.298563:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787136086.298576:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787136086.298590:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:247d1cf6-e699-400d-82b2-f0faea63f3e6:3303:1873947616449280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787136086.298630:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136086.298681:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787136086.298689:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:247d1cf6-e699-400d-82b2-f0faea63f3e6:3300:1873947616449152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787136086.298711:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136086.298745:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616449280 00000100:00100000:3.0:1787136086.298751:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616449280 00010000:00010000:3.0:1787136086.298773:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98820e3a00/0xf5850c552f203537 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f203530 expref: 19 pid: 14335 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136086.298795:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616449152 00000100:00100000:3.0:1787136086.298798:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616449152 00010000:00010000:3.0:1787136086.298809:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e9876c9b800/0xf5850c552f203672 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20366b expref: 20 pid: 14337 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136086.298820:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787136086.298826:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:247d1cf6-e699-400d-82b2-f0faea63f3e6+20:3303:x1873947616449280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787136086.298837:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787136086.298841:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98820e3a00/0xf5850c552f203537 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f203530 expref: 20 pid: 14335 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298858:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98820e3a00/0xf5850c552f203537 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f203530 expref: 20 pid: 14335 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.298875:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787136086.298904:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:247d1cf6-e699-400d-82b2-f0faea63f3e6+20:3303:x1873947616449280:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136086.298911:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787136086.299297:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136086.299367:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136086.300555:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595487872 00000100:00100000:3.0:1787136086.300564:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595487872 00010000:00010000:3.0:1787136086.300592:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98511da200/0xf5850c552f2037c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718660 expref: 13 pid: 14338 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136086.300612:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595488000 00000100:00100000:3.0:1787136086.300615:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595488000 00010000:00010000:3.0:1787136086.300627:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98511da000/0xf5850c552f203791 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185fe expref: 14 pid: 14338 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136086.300641:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787136086.300649:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:3300:x1873947616449152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787136086.300660:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787136086.300666:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e9876c9b800/0xf5850c552f203672 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f20366b expref: 19 pid: 14337 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.300677:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e9876c9b800/0xf5850c552f203672 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f20366b expref: 19 pid: 14337 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.300693:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787136086.300756:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:3300:x1873947616449152:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (2043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136086.300777:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787136086.300793:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1787136086.300799:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b60a4844-c244-49f5-a47a-c4b77f6694b7+14:2359:x1873947595487872:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787136086.300807:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787136086.300812:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98511da200/0xf5850c552f2037c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718660 expref: 14 pid: 14338 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.300823:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98511da200/0xf5850c552f2037c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718660 expref: 14 pid: 14338 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.300834:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787136086.300872:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b60a4844-c244-49f5-a47a-c4b77f6694b7+14:2359:x1873947595487872:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 73us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136086.300879:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:3.0:1787136086.300918:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:3.0:1787136086.300924:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:2359:x1873947595488000:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787136086.300930:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787136086.300935:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98511da000/0xf5850c552f203791 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185fe expref: 13 pid: 14338 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.300944:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98511da000/0xf5850c552f203791 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185fe expref: 13 pid: 14338 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.300954:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787136086.300971:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:2359:x1873947595488000:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 47us (1605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136086.300977:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1787136086.301372:0:16457:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984f020c00 going to sleep for 11 seconds 00010000:00010000:1.0:1787136086.301400:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511da200/0xf5850c552f2037c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718660 expref: 12 pid: 14338 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136086.301413:0:16457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1873947616448512:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787136086.301425:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511da000/0xf5850c552f203791 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7185fe expref: 11 pid: 14338 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136086.301443:0:16457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1873947616448640:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787136086.301467:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e9876c9b800/0xf5850c552f203672 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f20366b expref: 18 pid: 14337 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136086.301476:0:16457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1873947616448768:0@lo:104: 00010000:00010000:1.0:1787136086.301485:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98820e3a00/0xf5850c552f203537 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f203530 expref: 17 pid: 14335 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136086.301495:0:16457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1873947616448896:0@lo:104: 00000100:00100000:0.0:1787136086.301573:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:247d1cf6-e699-400d-82b2-f0faea63f3e6:3300:1873947616449152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787136086.301641:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616449024 00000100:00100000:2.0:1787136086.301646:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616449024 00000100:00100000:2.0:1787136086.301688:0:14327:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787136086.301701:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787136086.301708:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744f7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:247d1cf6-e699-400d-82b2-f0faea63f3e6+3:16457:x1873947616449024:12345-0@lo:104: 00010000:00010000:2.0:1787136086.301720:0:14327:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2034ea expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136086.301839:0:16457:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16457:1873947616449024:0@lo:104: 00010000:00010000:1.0:1787136086.301872:0:16457:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136086.302001:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:247d1cf6-e699-400d-82b2-f0faea63f3e6:3303:1873947616449280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787136086.302073:0:14327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787136086.302080:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744f7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:247d1cf6-e699-400d-82b2-f0faea63f3e6+3:16457:x1873947616449024:12345-0@lo:104: Request processed in 373us (9603us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136086.302087:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787136086.304315:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787136086.304329:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf5850c552f2034ea expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.304341:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98820e2800 already unused, calling callback (ffffffffc1c0dc20) 10000000:00010000:0.0:1787136086.304346:0:14332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf5850c552f2034ea expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.304356:0:14332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf5850c552f2034ea expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787136086.304365:0:14332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf5850c552f2034ea expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787136086.304371:0:14332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787136086.304435:0:14332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2034ea expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.304443:0:14332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787136086.304499:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1787136086.305156:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2034ea expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.305186:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.138@tcp lock: ffff8e98820e2800/0xf5850c552f2034e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf5850c552f2034ea expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.305205:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136086.305207:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136086.305210:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787136086.306452:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:247d1cf6-e699-400d-82b2-f0faea63f3e6:3302:1873947616449408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787136086.306525:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136086.306643:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616449408 00000100:00100000:0.0:1787136086.306651:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616449408 00010000:00010000:0.0:1787136086.306682:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e98533af800/0xf5850c552f2034ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2034e3 expref: 17 pid: 14337 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136086.306720:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787136086.306729:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:3302:x1873947616449408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787136086.306742:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787136086.306748:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e98533af800/0xf5850c552f2034ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf5850c552f2034e3 expref: 17 pid: 14337 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.306761:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e98533af800/0xf5850c552f2034ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf5850c552f2034e3 expref: 17 pid: 14337 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.306779:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98533af800/0xf5850c552f2034ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf5850c552f2034e3 expref: 17 pid: 14337 timeout: 546 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.306794:0:14330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.306802:0:14330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.306833:0:14330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.306841:0:14330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.306848:0:14330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.306855:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.306861:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511da400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787136086.306866:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.306873:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.306895:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136086.306906:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787136086.306944:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:3302:x1873947616449408:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136086.306952:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1787136086.308159:0:16457:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.308173:0:16457:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136086.308180:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e98511da400/0xf5850c552f2037f3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136086.309174:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:247d1cf6-e699-400d-82b2-f0faea63f3e6:3302:1873947616449408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787136086.623470:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787136087.640725:0:14340:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787136087.640733:0:14340:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e9851ee2000 from 10 10000000:01000000:1.0:1787136087.640738:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787136087.640793:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511da400/0xf5850c552f2037fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136087.640805:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e98511da400/0xf5850c552f2037fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136087.640817:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e98511da400/0xf5850c552f2037fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136087.640841:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616449536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787136087.640908:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136087.640957:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984f020c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787136087.640980:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616449536 00000100:00100000:1.0:1787136087.640987:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616449536 00000100:00100000:1.0:1787136087.641035:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787136087.641043:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+16:14340:x1873947616449536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787136087.641079:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136087.641092:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511dae00/0xf5850c552f203801 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f2037fa expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136087.641115:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511dae00/0xf5850c552f203801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f2037fa expref: 17 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136087.641124:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511dae00/0xf5850c552f203801 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f2037fa expref: 17 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136087.641133:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dae00, rc 0) 00000100:00100000:1.0:1787136087.641169:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:14340:x1873947616449536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136087.641176:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00010000:1.0:1787136087.641234:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787136087.641255:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616449536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787136087.641269:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e98511da400/0xf5850c552f2037fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203801 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136087.641278:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e98511da400/0xf5850c552f2037fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f203801 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136087.641323:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616449664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787136087.641344:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136087.641357:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e984f020c00 going to sleep for 11 seconds 00000100:00100000:1.0:1787136087.641368:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616449664 00000100:00100000:1.0:1787136087.641376:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616449664 00000100:00100000:1.0:1787136087.641397:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787136087.641403:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:14340:x1873947616449664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787136087.641622:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:14340:x1873947616449664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136087.641629:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787136087.641701:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616449664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787136087.641734:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616449792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787136087.641777:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136087.641812:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787136087.641972:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616449792 00000100:00100000:0.0:1787136087.641976:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616449792 00000100:00100000:0.0:1787136087.642002:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787136087.642009:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:14340:x1873947616449792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787136087.642216:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:14340:x1873947616449792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136087.642222:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1787136087.642269:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e10a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616449792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787136087.642883:0:16515:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787136087.642935:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787136087.642952:0:14340:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787136087.642961:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e98511da400/0xf5850c552f2037fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203801 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136087.642969:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e98511da400/0xf5850c552f2037fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f203801 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787136087.642978:0:14340:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787136087.642980:0:14340:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e984564f800 from 10 10000000:01000000:0.0:1787136087.642982:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787136087.643005:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874896e00/0xf5850c552f203808 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136087.643012:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9874896e00/0xf5850c552f203808 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136087.643022:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9874896e00/0xf5850c552f203808 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136087.643037:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616449920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787136087.643091:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136087.643115:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787136087.644510:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616449920 00000100:00100000:0.0:1787136087.644520:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616449920 00000100:00100000:0.0:1787136087.644617:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787136087.644627:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+17:14340:x1873947616449920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787136087.644642:0:14337:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787136087.644657:0:14337:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e9874897800/0xf5850c552f20380f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f203808 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136087.644682:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e9874897800/0xf5850c552f20380f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f203808 expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136087.644693:0:14337:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e9874897800/0xf5850c552f20380f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203808 expref: 18 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136087.644701:0:14337:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897800, rc 0) 00000100:00100000:0.0:1787136087.644757:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:14340:x1873947616449920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136087.644764:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787136087.644816:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616449920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787136087.644832:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9874896e00/0xf5850c552f203808 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20380f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136087.644841:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9874896e00/0xf5850c552f203808 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20380f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136087.644899:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616450048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787136087.644928:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136087.644951:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616450048 00000100:00100000:0.0:1787136087.644955:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787136087.644956:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616450048 00000100:00100000:1.0:1787136087.644982:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787136087.644990:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:14340:x1873947616450048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787136087.645295:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:14340:x1873947616450048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136087.645302:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787136087.645355:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616450048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787136087.645380:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616450176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787136087.645429:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136087.645475:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787136087.645502:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616450176 00000100:00100000:1.0:1787136087.645506:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616450176 00000100:00100000:1.0:1787136087.645553:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787136087.645567:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:14340:x1873947616450176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787136087.645696:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:14340:x1873947616450176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136087.645703:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1787136087.645896:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616450176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787136087.648551:0:16517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787136087.648630:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787136087.648649:0:14340:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787136087.648659:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874896e00/0xf5850c552f203808 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20380f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136087.648671:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9874896e00/0xf5850c552f203808 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20380f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787136087.648680:0:14340:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787136087.648683:0:14340:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff8e9876a4d800 from 10 10000000:01000000:0.0:1787136087.648686:0:14340:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787136087.648720:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874897a00/0xf5850c552f203816 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136087.648728:0:14340:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.138@tcp lock: ffff8e9874897a00/0xf5850c552f203816 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136087.648738:0:14340:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.138@tcp lock: ffff8e9874897a00/0xf5850c552f203816 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136087.648761:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616450304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787136087.650070:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136087.650123:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607adf00 going to sleep for 11 seconds 00000100:00100000:3.0:1787136087.650455:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616450304 00000100:00100000:3.0:1787136087.650463:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616450304 00000100:00100000:3.0:1787136087.650510:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787136087.650519:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+18:14340:x1873947616450304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787136087.650547:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136087.650563:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e987c2c7600/0xf5850c552f20381d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf5850c552f203816 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136087.650590:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e987c2c7600/0xf5850c552f20381d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf5850c552f203816 expref: 19 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136087.650611:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e987c2c7600/0xf5850c552f20381d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf5850c552f203816 expref: 19 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136087.650621:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7600, rc 0) 00000100:00100000:3.0:1787136087.650665:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:14340:x1873947616450304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136087.650671:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787136087.650730:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746baa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616450304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787136087.650747:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.138@tcp lock: ffff8e9874897a00/0xf5850c552f203816 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20381d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136087.650757:0:14340:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.138@tcp lock: ffff8e9874897a00/0xf5850c552f203816 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf5850c552f20381d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136087.650822:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616450432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787136087.650857:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136087.650878:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9741084480 going to sleep for 11 seconds 00000100:00100000:3.0:1787136087.650894:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616450432 00000100:00100000:3.0:1787136087.650897:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616450432 00000100:00100000:3.0:1787136087.650924:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787136087.650933:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98815bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:14340:x1873947616450432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787136087.655237:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98815bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:14340:x1873947616450432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4297us (4370us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136087.655254:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787136087.656185:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616450432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787136087.656241:0:14340:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9851e12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616450560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787136087.656314:0:14340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136087.656643:0:14340:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787136087.656798:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616450560 00000100:00100000:3.0:1787136087.656805:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616450560 00000100:00100000:3.0:1787136087.656859:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787136087.656869:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:14340:x1873947616450560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787136087.657101:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:14340:x1873947616450560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136087.658999:0:14340:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9851e12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:247d1cf6-e699-400d-82b2-f0faea63f3e6:14340:1873947616450560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787136087.660662:0:16520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787136087.660723:0:14340:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787136087.660743:0:14340:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.138@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787136087.660754:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.138@tcp lock: ffff8e9874897a00/0xf5850c552f203816 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20381d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136087.661861:0:14340:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.138@tcp lock: ffff8e9874897a00/0xf5850c552f203816 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf5850c552f20381d expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136087.662348:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787136087.847633:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136087.847887:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595488128 00000100:00100000:1.0:1787136087.847898:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595488128 00000100:00100000:1.0:1787136087.847952:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:1.0:1787136087.847962:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+11:13751:x1873947595488128:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787136087.847989:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136087.848006:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511dac00/0xf5850c552f203824 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b718691 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136087.848040:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511dac00/0xf5850c552f203824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718691 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136087.848082:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511dac00/0xf5850c552f203824 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718691 expref: 12 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136087.848091:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511dac00, rc 0) 00000100:00100000:1.0:1787136087.848162:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+12:13751:x1873947595488128:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 202us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136087.848170:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 114 00000100:00100000:0.0:1787136087.855352:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136087.855692:0:14337:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595488256 00000100:00100000:1.0:1787136087.855702:0:14337:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595488256 00000100:00100000:1.0:1787136087.855758:0:14337:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:1.0:1787136087.855768:0:14337:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+12:13751:x1873947595488256:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787136087.856078:0:14337:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b60a4844-c244-49f5-a47a-c4b77f6694b7+12:13751:x1873947595488256:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 281us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136087.856087:0:14337:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 115 00000100:00100000:0.0:1787136087.859349:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136087.859937:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595488384 00000100:00100000:2.0:1787136087.859951:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595488384 00000100:00100000:2.0:1787136087.860261:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:2.0:1787136087.860273:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+12:13751:x1873947595488384:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787136087.860535:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+12:13751:x1873947595488384:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 264us (1194us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136087.860551:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 116 00000100:00100000:0.0:1787136087.868939:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136087.869016:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595488512 00000100:00100000:1.0:1787136087.869026:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595488512 00000100:00100000:1.0:1787136087.869108:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:1.0:1787136087.869117:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+12:13751:x1873947595488512:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787136087.869134:0:14338:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136087.869356:0:14338:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e98511db800/0xf5850c552f20382b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2eee43441b718698 expref: -99 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136087.869394:0:14338:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e98511db800/0xf5850c552f20382b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718698 expref: 13 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136087.869429:0:14338:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e98511db800/0xf5850c552f20382b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718698 expref: 13 pid: 14338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136087.869439:0:14338:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db800, rc 0) 00000100:00100000:1.0:1787136087.869499:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13751:x1873947595488512:12345-192.168.203.38@tcp:101:ll_cfg_requeue.0 Request processed in 384us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136087.869506:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 117 00000100:00100000:0.0:1787136087.871271:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136087.873160:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595488640 00000100:00100000:2.0:1787136087.873175:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595488640 00000100:00100000:2.0:1787136087.873258:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:2.0:1787136087.873496:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13751:x1873947595488640:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787136087.874133:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13751:x1873947595488640:12345-192.168.203.38@tcp:501:ll_cfg_requeue.0 Request processed in 863us (3009us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136087.874143:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 118 00000100:00100000:0.0:1787136087.876221:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136087.876295:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595488768 00000100:00100000:1.0:1787136087.876304:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595488768 00000100:00100000:1.0:1787136087.876363:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:1.0:1787136087.876381:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13751:x1873947595488768:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787136087.876605:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:13751:x1873947595488768:12345-192.168.203.38@tcp:503:ll_cfg_requeue.0 Request processed in 224us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136087.876614:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 119 00000100:00100000:2.0:1787136088.029699:0:3301:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787136088.029721:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616450688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787136088.029786:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136088.032646:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616450688 00000100:00100000:3.0:1787136088.032659:0:15031:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616450688 00000100:00100000:3.0:1787136088.032730:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787136088.032751:0:15031:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616450688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787136088.032787:0:15031:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787136088.032846:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787136088.033145:0:15031:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3301:x1873947616450688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 395us (3358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136088.033153:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787136088.033204:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3301:1873947616450688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787136088.664371:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787136089.560546:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:247d1cf6-e699-400d-82b2-f0faea63f3e6:3301:1873947616450816:0@lo:400:kworker.0 00000100:00100000:1.0:1787136089.560682:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616451072:0@lo:400:kworker.0 00000100:00100000:2.0:1787136089.560816:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616450944:0@lo:400:kworker.0 00000100:00100000:0.0:1787136089.561626:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616451200:0@lo:400:kworker.0 00000100:00100000:1.0:1787136089.563663:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136089.563692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136089.563738:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98746baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616451584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787136089.563801:0:3302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616451456:0@lo:400:kworker.0 00000100:00100000:1.0:1787136089.563953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136089.564121:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136089.564155:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616451072 00000100:00100000:2.0:1787136089.564163:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616451072 00000100:00100000:2.0:1787136089.564208:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616450944 00000100:00100000:2.0:1787136089.564211:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616450944 00000100:00100000:2.0:1787136089.564228:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787136089.564231:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136089.564236:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616451072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787136089.564257:0:3301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616451328:0@lo:400:kworker.0 00000100:00100000:3.0:1787136089.564280:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787136089.564369:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616451072:12345-0@lo:400:kworker.0 Request processed in 133us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136089.564376:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787136089.564387:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787136089.564394:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787136089.564398:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616451584 00000100:00100000:3.0:1787136089.564401:0:15032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616451584 00000100:00100000:2.0:1787136089.564401:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616450944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787136089.564439:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787136089.564445:0:15032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616451584:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787136089.564449:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1873947616450944:12345-0@lo:400:kworker.0 Request processed in 49us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136089.564455:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00002000:00000024:3.0:1787136089.564468:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787136089.564472:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616450816 00000100:00100000:2.0:1787136089.564475:0:14335:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616450816 00000100:00100000:3.0:1787136089.564503:0:15032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1873947616451584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136089.564509:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787136089.564554:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3302:1873947616450944:0@lo:400:kworker.0 00000100:00100000:2.0:1787136089.564567:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787136089.564574:0:14335:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:3301:x1873947616450816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787136089.564655:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616451456 00000100:00100000:3.0:1787136089.564659:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616451456 00000100:00100000:2.0:1787136089.564682:0:14335:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:247d1cf6-e699-400d-82b2-f0faea63f3e6+19:3301:x1873947616450816:12345-0@lo:400:kworker.0 Request processed in 109us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136089.564686:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616451328 00000100:00100000:3.0:1787136089.564688:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616451328 00000100:00100000:2.0:1787136089.564700:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787136089.564706:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787136089.564712:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616451456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787136089.564757:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1873947616451456:12345-0@lo:400:kworker.0 Request processed in 45us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136089.564763:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787136089.564809:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787136089.564816:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616451328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136089.564847:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1873947616451328:12345-0@lo:400:kworker.0 Request processed in 31us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136089.564853:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787136089.564934:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787136089.565032:0:3302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3302:1873947616451456:0@lo:400:kworker.0 00000100:00100000:0.0:1787136089.565280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787136089.565924:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98746baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616451584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787136089.565949:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3303:1873947616451072:0@lo:400:kworker.0 00000100:00100000:3.0:1787136089.566023:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616451200 00000100:00100000:3.0:1787136089.566029:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616451200 00000100:00100000:3.0:1787136089.566145:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787136089.566157:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616451200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787136089.566166:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:247d1cf6-e699-400d-82b2-f0faea63f3e6:3301:1873947616450816:0@lo:400:kworker.0 00000100:00100000:2.0:1787136089.566186:0:3301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3301:1873947616451328:0@lo:400:kworker.0 00000100:00100000:3.0:1787136089.566223:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3300:x1873947616451200:12345-0@lo:400:kworker.0 Request processed in 68us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136089.566232:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787136089.566264:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3300:1873947616451200:0@lo:400:kworker.0 00010000:00010000:3.0:1787136089.688326:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787136089.688874:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136089.689011:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595488896 00000100:00100000:3.0:1787136089.689021:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595488896 00000100:00100000:3.0:1787136089.689138:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:3.0:1787136089.689150:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:14407:x1873947595488896:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787136089.689174:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136089.689200:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7e00/0xf5850c552f203832 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71869f expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.689275:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203839 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787136089.689372:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787136089.689402:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203839 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.689428:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203839 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.689460:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f203840 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.689473:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f203840 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.689479:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f203840 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.694989:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203847 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695012:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203847 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695024:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203847 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787136089.695207:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787136089.695211:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787136089.695871:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203847 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695887:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203839 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695895:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203839 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695902:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203839 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695921:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787136089.695926:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203839 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695934:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203839 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695950:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98820fc700) 00010000:00010000:3.0:1787136089.695953:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787136089.695958:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203839 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695964:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203839 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695978:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f203840 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695985:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f203840 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695990:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f203840 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.695995:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787136089.695998:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f203840 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.696004:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f203840 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.696023:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e98437a7e00) 00010000:00010000:3.0:1787136089.696026:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787136089.696029:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f203840 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.696035:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f203840 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.696383:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7e00/0xf5850c552f203832 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71869f expref: 8 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.696400:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7800/0xf5850c552f203847 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71869f expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.696419:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e98437a7700) 00010000:00010000:3.0:1787136089.696422:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787136089.696424:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7800, rc 0) 00000100:00100000:3.0:1787136089.696496:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+7:14407:x1873947595488896:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 7348us (7626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136089.696504:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:0.0:1787136089.700156:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136089.702503:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595489152 00000100:00100000:3.0:1787136089.702517:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595489152 00000100:00100000:3.0:1787136089.702588:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:3.0:1787136089.702599:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+7:14407:x1873947595489152:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787136089.702620:0:15677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136089.702639:0:15677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f20384e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186a6 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.702729:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f203855 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.702742:0:15677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f203855 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.702765:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f203855 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.702826:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f20385c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.702834:0:15677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f20385c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.702841:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f20385c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.704658:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203863 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.704677:0:15677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203863 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.704686:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203863 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787136089.704697:0:15677:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787136089.704968:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f203855 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.704986:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f203855 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.704993:0:15677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f203855 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.705000:0:15677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787136089.705004:0:15677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f203855 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.705012:0:15677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f203855 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.705026:0:15677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e98437a7700) 00010000:00010000:3.0:1787136089.705030:0:15677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787136089.705036:0:15677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f203855 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.705041:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f203855 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.705085:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f20385c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.705092:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f20385c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.705643:0:15677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f20385c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.705653:0:15677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787136089.705663:0:15677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f20385c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.705670:0:15677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f20385c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.705679:0:15677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e98437a7800) 00010000:00010000:3.0:1787136089.705682:0:15677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787136089.705684:0:15677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f20385c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.705690:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f20385c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.706156:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f20384e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186a6 expref: 10 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.706173:0:15677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7200/0xf5850c552f203863 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186a6 expref: 9 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.706181:0:15677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e98437a7e00) 00010000:00010000:3.0:1787136089.706184:0:15677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787136089.706186:0:15677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7200, rc 0) 00000100:00100000:3.0:1787136089.706250:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+9:14407:x1873947595489152:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 3651us (6100us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787136089.706258:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1787136089.709557:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136089.709664:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595489280 00000100:00100000:1.0:1787136089.709675:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595489280 00000100:00100000:1.0:1787136089.709733:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:1.0:1787136089.709773:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+9:14407:x1873947595489280:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787136089.709873:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+9:14407:x1873947595489280:12345-192.168.203.38@tcp:59:lhsmtool_posix.0 Request processed in 110us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136089.709880:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:0.0:1787136089.787388:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136089.787516:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595489408 00000100:00100000:1.0:1787136089.787526:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595489408 00000100:00100000:1.0:1787136089.787584:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:1.0:1787136089.787594:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+9:14413:x1873947595489408:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787136089.787613:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136089.787633:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203871 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186ad expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.787699:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f203878 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.787713:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f203878 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.787723:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f203878 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.787736:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20387f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.787743:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20387f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.787750:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20387f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.787997:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f203878 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788005:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f203878 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788013:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f203878 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788019:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511da000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787136089.788024:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f203878 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788031:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f203878 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788044:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98820fc700) 00010000:00010000:1.0:1787136089.788094:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787136089.788099:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f203878 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788105:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f203878 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788117:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20387f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788123:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20387f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788129:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20387f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788141:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511da600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787136089.788144:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20387f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788150:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20387f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788158:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e98600ef100) 00010000:00010000:1.0:1787136089.788161:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787136089.788164:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20387f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788170:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20387f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788200:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203871 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186ad expref: 10 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788222:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98820fc700) 00010000:00010000:1.0:1787136089.788224:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787136089.788227:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203871 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186ad expref: 10 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.788236:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da200, rc 0) 00000100:00100000:1.0:1787136089.788283:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+9:14413:x1873947595489408:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 691us (903us total) trans 0 rc 301/301 00000100:00100000:1.0:1787136089.788291:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 18 00000100:00100000:0.0:1787136089.794319:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136089.795302:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595489536 00000100:00100000:2.0:1787136089.795313:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595489536 00000100:00100000:2.0:1787136089.795369:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1787136089.795379:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:60a6a922-6d90-4897-b90a-1b9618ede7d7+9:14413:x1873947595489536:12345-192.168.203.38@tcp:700:lfs.0 00000100:00100000:2.0:1787136089.795476:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:60a6a922-6d90-4897-b90a-1b9618ede7d7+9:14413:x1873947595489536:12345-192.168.203.38@tcp:700:lfs.0 Request processed in 98us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136089.795484:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1787136089.798545:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136089.798632:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595489792 00000100:00100000:1.0:1787136089.798652:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595489792 00000100:00100000:1.0:1787136089.798703:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00100000:1.0:1787136089.798712:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+9:14413:x1873947595489792:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:1.0:1787136089.798765:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787136089.798792:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ae00/0xf5850c552f2037b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718628 expref: 9 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.798812:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98820fc700) 00010000:00010000:1.0:1787136089.798817:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787136089.801352:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.801375:0:14343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2037ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71868a expref: 5 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.801384:0:14343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.801431:0:14343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2037ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71868a expref: 5 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.801447:0:14343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2037ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71868a expref: 5 pid: 14344 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136089.801460:0:14343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14343:1873947616451712:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787136089.801555:0:14343:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9849707600 going to sleep for 11 seconds 00000100:00100000:0.0:1787136089.806705:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136089.806827:0:14343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14343:1873947616451712:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787136089.806853:0:14343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136089.806936:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595489920 00000100:00100000:2.0:1787136089.806943:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595489920 00010000:00010000:2.0:1787136089.806994:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2037ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71868a expref: 6 pid: 14344 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136089.807034:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:2.0:1787136089.807044:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da5b72c-7294-4368-981d-7e3e213210e1+6:2360:x1873947595489920:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787136089.807087:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787136089.807095:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2037ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71868a expref: 6 pid: 14344 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.807119:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2037ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71868a expref: 6 pid: 14344 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.807151:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2037ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b71868a expref: 6 pid: 14344 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.807177:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98820fc700) 00010000:00010000:2.0:1787136089.807182:0:14328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.807191:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.807198:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.807219:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787136089.807268:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6da5b72c-7294-4368-981d-7e3e213210e1+5:2360:x1873947595489920:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 226us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136089.807276:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00010000:00010000:1.0:1787136089.807516:0:14343:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.807525:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.807548:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20388d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.807557:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20388d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.807564:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20388d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787136089.808896:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787136089.808910:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.808918:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.808924:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.808929:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511da200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787136089.808933:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.808941:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.808964:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98820fc700) 00010000:00010000:1.0:1787136089.808967:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787136089.808972:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.808977:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203886 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787136089.808995:0:14343:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 0000000002241b51 reply state 00000000dd7d60ca transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20388d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136089.809003:0:14343:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787136089.809099:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+10:14413:x1873947595489792:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 10385us (10561us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787136089.809106:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 19 00000100:00080000:0.0:1787136089.811537:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787136089.813641:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20388d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.813657:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20388d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.813676:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20388d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.813682:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511da600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787136089.813687:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20388d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.813695:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20388d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.813711:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e98600ef100) 00010000:00010000:3.0:1787136089.813714:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787136089.813718:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20388d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.813725:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f20388d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136089.894631:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136089.894732:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595490048 00000100:00100000:1.0:1787136089.894741:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595490048 00000100:00100000:1.0:1787136089.894807:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:1.0:1787136089.894817:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+9:14421:x1873947595490048:12345-192.168.203.38@tcp:101:lctl.0 00010000:00010000:1.0:1787136089.894839:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136089.894863:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203894 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186b4 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.894926:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20389b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.894941:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20389b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.894968:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20389b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787136089.895027:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787136089.895031:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1787136089.895108:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20389b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.895133:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f203894 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186b4 expref: 11 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.895152:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da000/0xf5850c552f20389b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186b4 expref: 10 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.895160:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98600ef100) 00010000:00010000:1.0:1787136089.895163:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787136089.895166:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511da000, rc 0) 00000100:00100000:1.0:1787136089.895230:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+10:14421:x1873947595490048:12345-192.168.203.38@tcp:101:lctl.0 Request processed in 415us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136089.895237:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 20 00000100:00100000:0.0:1787136089.926256:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136089.926661:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595490176 00000100:00100000:3.0:1787136089.926670:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595490176 00000100:00100000:3.0:1787136089.926871:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:3.0:1787136089.926883:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da5b72c-7294-4368-981d-7e3e213210e1+5:14422:x1873947595490176:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787136089.926903:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136089.926922:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186bb expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.926984:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2038a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.927011:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2038a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.927022:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2038a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787136089.927120:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787136089.927125:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787136089.927153:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2038a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.927177:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186bb expref: 7 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.927197:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6200/0xf5850c552f2038a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186bb expref: 6 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.927205:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98600ef100) 00010000:00010000:3.0:1787136089.927208:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787136089.927212:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6200, rc 0) 00000100:00100000:3.0:1787136089.927285:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da5b72c-7294-4368-981d-7e3e213210e1+6:14422:x1873947595490176:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 405us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136089.927293:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 21 00000100:00100000:0.0:1787136089.930315:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136089.930376:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595490304 00000100:00100000:1.0:1787136089.930385:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595490304 00000100:00100000:1.0:1787136089.930457:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:1.0:1787136089.930467:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da5b72c-7294-4368-981d-7e3e213210e1+6:14422:x1873947595490304:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787136089.930486:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136089.930505:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f2038b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186c2 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930597:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2038b7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930611:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2038b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930622:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2038b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930636:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f2038be lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930643:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f2038be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930650:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f2038be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930740:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2038c5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930746:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2038c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930750:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2038c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787136089.930779:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787136089.930782:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787136089.930804:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2038c5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930825:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2038b7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930832:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2038b7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930839:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2038b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930845:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511db400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787136089.930849:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2038b7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930856:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2038b7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930868:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98600ef100) 00010000:00010000:1.0:1787136089.930871:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787136089.930876:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2038b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930882:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db400/0xf5850c552f2038b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930896:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f2038be lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930902:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f2038be lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930907:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f2038be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930918:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98511da600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787136089.930921:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f2038be lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930927:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f2038be lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930936:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e98600efe00) 00010000:00010000:1.0:1787136089.930939:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787136089.930941:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f2038be lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930947:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da600/0xf5850c552f2038be lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930978:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511da200/0xf5850c552f2038b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186c2 expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930990:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2038c5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186c2 expref: 7 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.930997:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e98600ef800) 00010000:00010000:1.0:1787136089.930999:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787136089.931000:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98511db200, rc 0) 00000100:00100000:1.0:1787136089.931104:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da5b72c-7294-4368-981d-7e3e213210e1+7:14422:x1873947595490304:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 631us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136089.931112:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 22 00000100:00100000:2.0:1787136089.936564:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136089.936666:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595490560 00000100:00100000:1.0:1787136089.936686:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595490560 00000100:00100000:1.0:1787136089.936741:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:1.0:1787136089.936975:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da5b72c-7294-4368-981d-7e3e213210e1+7:14422:x1873947595490560:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787136089.936995:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136089.937015:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2038cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186c9 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787136089.937378:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787136089.937513:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2038cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186c9 expref: 9 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.937528:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98600ef100) 00010000:00010000:1.0:1787136089.937531:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787136089.937536:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2038cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186c9 expref: 9 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.937551:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533af800, rc 0) 00000100:00100000:1.0:1787136089.938366:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6da5b72c-7294-4368-981d-7e3e213210e1+8:14422:x1873947595490560:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 1612us (1807us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1787136089.938375:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 23 00000100:00100000:0.0:1787136089.942615:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136089.942830:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595490816 00000100:00100000:3.0:1787136089.942839:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595490816 00000100:00100000:3.0:1787136089.942899:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:3.0:1787136089.942908:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da5b72c-7294-4368-981d-7e3e213210e1+8:14422:x1873947595490816:12345-192.168.203.38@tcp:36:lfs.0 00010000:00010000:3.0:1787136089.942958:0:15677:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787136089.942998:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98511db200/0xf5850c552f2038c5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186c2 expref: 8 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.943016:0:15677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e98600ef800) 00010000:00010000:3.0:1787136089.943026:0:15677:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787136089.943085:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038da lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.943104:0:15677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.943116:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787136089.944259:0:15677:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 000000001a4b831d reply state 000000009e4ab593 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136089.944391:0:15677:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1787136089.944428:0:15677:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787136089.944955:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6da5b72c-7294-4368-981d-7e3e213210e1+9:14422:x1873947595490816:12345-192.168.203.38@tcp:36:lfs.0 Request processed in 2044us (2443us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787136089.944964:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000040:00080000:3.0:1787136089.947136:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787136089.949869:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038da lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.949886:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038da lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.949893:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.949908:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787136089.949913:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038da lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.949921:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038da lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.949935:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:1.0:1787136089.949938:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787136089.949942:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038da lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.949948:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7c00/0xf5850c552f2038da lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136089.952008:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136089.952310:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595491072 00000100:00100000:1.0:1787136089.952321:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595491072 00000100:00100000:1.0:1787136089.952375:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:1.0:1787136089.952385:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da5b72c-7294-4368-981d-7e3e213210e1+8:14422:x1873947595491072:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1787136089.952635:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da5b72c-7294-4368-981d-7e3e213210e1+9:14422:x1873947595491072:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 250us (633us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787136089.952643:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1787136089.961726:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136089.961859:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595491328 00000100:00100000:3.0:1787136089.961869:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595491328 00000100:00100000:3.0:1787136089.961929:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:3.0:1787136089.961939:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da5b72c-7294-4368-981d-7e3e213210e1+9:14422:x1873947595491328:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787136089.961964:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136089.961984:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2038e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186d0 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.962123:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7e00/0xf5850c552f2038e8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.962138:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7e00/0xf5850c552f2038e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.962149:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7e00/0xf5850c552f2038e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.962163:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2038ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.962170:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2038ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136089.962177:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2038ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787136089.965896:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787136089.966012:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7e00/0xf5850c552f2038e8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966025:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7e00/0xf5850c552f2038e8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966068:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7e00/0xf5850c552f2038e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966074:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787136089.966079:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7e00/0xf5850c552f2038e8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966087:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7e00/0xf5850c552f2038e8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966117:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98600ef100) 00010000:00010000:2.0:1787136089.966121:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787136089.966126:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7e00/0xf5850c552f2038e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966132:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7e00/0xf5850c552f2038e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966146:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2038ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966153:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2038ef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966159:0:14345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2038ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966164:0:14345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787136089.966166:0:14345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2038ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966182:0:14345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2038ef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966189:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e98437a7600) 00010000:00010000:2.0:1787136089.966192:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787136089.966195:0:14345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2038ef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966200:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6600/0xf5850c552f2038ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966424:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2038e1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186d0 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966436:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98600ef100) 00010000:00010000:2.0:1787136089.966438:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787136089.966442:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6400/0xf5850c552f2038e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186d0 expref: 11 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136089.966452:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6400, rc 0) 00000100:00100000:2.0:1787136089.966606:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da5b72c-7294-4368-981d-7e3e213210e1+10:14422:x1873947595491328:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 4667us (4888us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787136089.966615:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:2.0:1787136089.978586:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136089.978661:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595491456 00000100:00100000:1.0:1787136089.978671:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595491456 00000100:00100000:1.0:1787136089.978727:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:1.0:1787136089.978738:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da5b72c-7294-4368-981d-7e3e213210e1+10:14422:x1873947595491456:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787136089.978759:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136089.978793:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2038fd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186d7 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.978875:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203904 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.978889:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.978900:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787136089.978946:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1787136089.978949:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787136089.978972:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203904 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.978997:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f2038fd lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186d7 expref: 12 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.979013:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203904 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186d7 expref: 11 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136089.979021:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e98600efe00) 00010000:00010000:1.0:1787136089.979024:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787136089.979027:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533afa00, rc 0) 00000100:00100000:1.0:1787136089.979114:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6da5b72c-7294-4368-981d-7e3e213210e1+11:14422:x1873947595491456:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 377us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136089.979120:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 26 00000100:00100000:0.0:1787136089.983723:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136089.984695:0:14347:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595491584 00000100:00100000:3.0:1787136089.984706:0:14347:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595491584 00000100:00100000:3.0:1787136089.984764:0:14347:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:3.0:1787136089.984775:0:14347:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da5b72c-7294-4368-981d-7e3e213210e1+11:14422:x1873947595491584:12345-192.168.203.38@tcp:37:lfs.0 00000100:00100000:3.0:1787136090.003230:0:14347:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6da5b72c-7294-4368-981d-7e3e213210e1+11:14422:x1873947595491584:12345-192.168.203.38@tcp:37:lfs.0 Request processed in 18447us (19503us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136090.003244:0:14347:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:2.0:1787136090.011484:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.011589:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595491840 00000100:00100000:1.0:1787136090.011613:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595491840 00000100:00100000:1.0:1787136090.011678:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:1.0:1787136090.011689:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9744a50050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da5b72c-7294-4368-981d-7e3e213210e1+11:14422:x1873947595491840:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1787136090.011950:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9744a50050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6da5b72c-7294-4368-981d-7e3e213210e1+12:14422:x1873947595491840:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 261us (472us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787136090.011959:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:0.0:1787136090.062451:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.062568:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595491968 00000100:00100000:1.0:1787136090.062579:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595491968 00000100:00100000:1.0:1787136090.062637:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:1.0:1787136090.062648:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+10:14428:x1873947595491968:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1787136090.062669:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136090.062689:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f20390b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186de expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.062751:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f203912 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.062905:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f203912 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.062918:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f203912 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.062933:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f203919 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.062940:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f203919 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.062947:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f203919 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063294:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203920 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063305:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203920 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063313:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203920 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787136090.063345:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787136090.063348:0:14343:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787136090.063388:0:14343:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203920 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063399:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f203912 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063416:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f203912 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063422:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f203912 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063428:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533af200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787136090.063438:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f203912 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063447:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f203912 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063459:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98600ef100) 00010000:00010000:0.0:1787136090.063462:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787136090.063467:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f203912 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063473:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af200/0xf5850c552f203912 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063486:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f203919 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063492:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f203919 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063498:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f203919 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063502:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787136090.063505:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f203919 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063510:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f203919 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063518:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e98600ef500) 00010000:00010000:0.0:1787136090.063520:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787136090.063530:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f203919 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063535:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae600/0xf5850c552f203919 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063567:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af800/0xf5850c552f20390b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186de expref: 12 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063580:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896200/0xf5850c552f203920 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186de expref: 11 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.063586:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e98600efe00) 00010000:00010000:0.0:1787136090.063588:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787136090.063590:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896200, rc 0) 00000100:00100000:0.0:1787136090.063651:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+11:14428:x1873947595491968:12345-192.168.203.38@tcp:101:bash.0 Request processed in 1005us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136090.063658:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 27 00000100:00100000:0.0:1787136090.067312:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.067411:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595492224 00000100:00100000:1.0:1787136090.067421:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595492224 00000100:00100000:1.0:1787136090.067515:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 28 00000100:00100000:1.0:1787136090.067526:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+11:14428:x1873947595492224:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:1.0:1787136090.067546:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136090.067563:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f203927 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186e5 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.067681:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.067696:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203904 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186d7 expref: 11 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.067705:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.067739:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203904 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186d7 expref: 11 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.067764:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203904 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186d7 expref: 11 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136090.067793:0:14344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987420ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14344:1873947616451840:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787136090.067882:0:14344:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9850377780 going to sleep for 11 seconds 00000100:00100000:1.0:1787136090.070318:0:14344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987420ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14344:1873947616451840:192.168.203.38@tcp:104: 00010000:00010000:1.0:1787136090.070363:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136090.071703:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.071987:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595492352 00000100:00100000:1.0:1787136090.071996:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595492352 00010000:00010000:1.0:1787136090.072036:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203904 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186d7 expref: 12 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136090.072236:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:1.0:1787136090.072247:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da5b72c-7294-4368-981d-7e3e213210e1+12:2360:x1873947595492352:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787136090.072262:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787136090.072270:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203904 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186d7 expref: 12 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.072283:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203904 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186d7 expref: 12 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.072305:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203904 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186d7 expref: 12 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.072320:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e98600efe00) 00010000:00010000:1.0:1787136090.072325:0:14329:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.072333:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.072341:0:14329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.072383:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787136090.072545:0:14344:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.072553:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.072582:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203935 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.072593:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203935 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.072600:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203935 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.073325:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20393c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.073336:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20393c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.073343:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20393c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787136090.073352:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787136090.073377:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.073384:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.073391:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.073397:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533af400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787136090.073411:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.073431:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.073441:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e98600efe00) 00010000:00010000:3.0:1787136090.073443:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787136090.073448:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.073455:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533af400/0xf5850c552f20392e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787136090.073467:0:14344:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000936dbb57 reply state 00000000401f2c91 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203935 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136090.073476:0:14344:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787136090.073508:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aec00/0xf5850c552f203927 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186e5 expref: 14 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.073522:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20393c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186e5 expref: 13 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.073529:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:3.0:1787136090.073531:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787136090.073533:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7a00, rc 0) 00000100:00100000:1.0:1787136090.073634:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6da5b72c-7294-4368-981d-7e3e213210e1+11:2360:x1873947595492352:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 1388us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136090.073644:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1787136090.073913:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+14:14428:x1873947595492224:12345-192.168.203.38@tcp:101:bash.0 Request processed in 6390us (6610us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787136090.073920:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 28 00010000:00010000:3.0:1787136090.079911:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203935 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.079941:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203935 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.079949:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203935 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.079955:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787136090.079961:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203935 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.079969:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203935 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.079985:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e98437a7600) 00010000:00010000:3.0:1787136090.079988:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787136090.079992:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203935 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.079998:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203935 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136090.085123:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136090.085259:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595492480 00000100:00100000:2.0:1787136090.085269:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595492480 00000100:00100000:2.0:1787136090.085326:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:2.0:1787136090.085349:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+13:14428:x1873947595492480:12345-192.168.203.38@tcp:101:bash.0 00010000:00010000:2.0:1787136090.085373:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787136090.085394:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20394a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186ec expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.085462:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.085475:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.085485:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787136090.085522:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787136090.085527:0:14345:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787136090.085546:0:14345:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.085555:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.085577:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20394a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186ec expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.085596:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186ec expref: 14 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.085603:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:2.0:1787136090.085606:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787136090.085616:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9876c9ba00, rc 0) 00000100:00100000:2.0:1787136090.085675:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+14:14428:x1873947595492480:12345-192.168.203.38@tcp:101:bash.0 Request processed in 329us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136090.085681:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 29 00000100:00100000:2.0:1787136090.089797:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.089938:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595492736 00000100:00100000:1.0:1787136090.089948:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595492736 00000100:00100000:1.0:1787136090.090008:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:1.0:1787136090.090018:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+14:14428:x1873947595492736:12345-192.168.203.38@tcp:35:bash.0 00000100:00100000:1.0:1787136090.090430:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+15:14428:x1873947595492736:12345-192.168.203.38@tcp:35:bash.0 Request processed in 413us (640us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787136090.090439:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1787136090.188707:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136090.188792:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595492992 00000100:00100000:3.0:1787136090.188803:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595492992 00000100:00100000:3.0:1787136090.188860:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:3.0:1787136090.188870:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+15:14438:x1873947595492992:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:3.0:1787136090.188892:0:15677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136090.188912:0:15677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203958 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186f3 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787136090.189037:0:15677:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787136090.189188:0:15677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203958 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186f3 expref: 17 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.189203:0:15677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e98600ef100) 00010000:00010000:3.0:1787136090.189207:0:15677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787136090.189212:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203958 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186f3 expref: 17 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.189227:0:15677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6e00, rc 0) 00000100:00100000:3.0:1787136090.189368:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+16:14438:x1873947595492992:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 499us (669us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787136090.189376:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 30 00000100:00100000:0.0:1787136090.193724:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.193820:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595493248 00000100:00100000:1.0:1787136090.193829:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595493248 00000100:00100000:1.0:1787136090.193879:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:1.0:1787136090.193888:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+16:14438:x1873947595493248:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:1.0:1787136090.194178:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+17:14438:x1873947595493248:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 289us (462us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787136090.194185:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1787136090.255382:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.255610:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595493504 00000100:00100000:1.0:1787136090.255620:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595493504 00000100:00100000:1.0:1787136090.255680:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:1.0:1787136090.255690:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9851e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+17:14441:x1873947595493504:12345-192.168.203.38@tcp:101:lfs.0 00010000:00010000:1.0:1787136090.255716:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136090.255737:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203966 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b7186fa expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.256007:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20396d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.256023:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20396d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.256036:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20396d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787136090.256188:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787136090.262462:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afa00/0xf5850c552f203966 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186fa expref: 20 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.262492:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20396d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186fa expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.262502:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:0.0:1787136090.262517:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787136090.262521:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533aee00, rc 0) 00000100:00100000:0.0:1787136090.262669:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9851e10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+19:14441:x1873947595493504:12345-192.168.203.38@tcp:101:lfs.0 Request processed in 6978us (7293us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787136090.262678:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 31 00000100:00100000:2.0:1787136090.274837:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136090.274984:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595493632 00000100:00100000:3.0:1787136090.274993:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595493632 00000100:00100000:3.0:1787136090.275085:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:3.0:1787136090.275096:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+19:14441:x1873947595493632:12345-192.168.203.38@tcp:54:lfs.0 00010000:00010000:3.0:1787136090.275161:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20397b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.275177:0:15677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20397b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.275189:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20397b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.275214:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20397b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.275234:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20397b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.275241:0:15677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20397b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.275247:0:15677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:3.0:1787136090.275251:0:15677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20397b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.275259:0:15677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20397b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.275271:0:15677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:3.0:1787136090.275274:0:15677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787136090.275279:0:15677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20397b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136090.275285:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f20397b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136090.275360:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+19:14441:x1873947595493632:12345-192.168.203.38@tcp:54:lfs.0 Request processed in 266us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136090.275369:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 32 00000100:00100000:3.0:1787136090.278473:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136090.281847:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595493760 00000100:00100000:0.0:1787136090.281862:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595493760 00000100:00100000:0.0:1787136090.282016:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1787136090.282028:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+19:2359:x1873947595493760:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787136090.282045:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787136090.282085:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533aee00/0xf5850c552f20396d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186fa expref: 19 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.282105:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:0.0:1787136090.285145:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787136090.285360:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+18:2359:x1873947595493760:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 3328us (6890us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136090.285372:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1787136090.286825:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136090.286922:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595494016 00000100:00100000:3.0:1787136090.286931:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595494016 00000100:00100000:3.0:1787136090.286982:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:3.0:1787136090.286992:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+18:14441:x1873947595494016:12345-192.168.203.38@tcp:35:lfs.0 00000100:00100000:3.0:1787136090.287258:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+19:14441:x1873947595494016:12345-192.168.203.38@tcp:35:lfs.0 Request processed in 267us (438us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787136090.287383:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:0.0:1787136090.472212:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136090.472260:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136090.472295:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136090.472332:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136090.472356:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136090.472375:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136090.472413:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136090.472438:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595494272 00000100:00100000:0.0:1787136090.472447:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595494272 00000100:00100000:0.0:1787136090.472492:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595494656 00000100:00100000:0.0:1787136090.472496:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595494656 00000100:00100000:0.0:1787136090.472518:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:0.0:1787136090.472702:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+19:2359:x1873947595494272:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787136090.472778:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+19:2359:x1873947595494272:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 239us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136090.472786:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 24 00000100:00100000:0.0:1787136090.472806:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:0.0:1787136090.472812:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da5b72c-7294-4368-981d-7e3e213210e1+11:2359:x1873947595494656:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:0.0:1787136090.472840:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6da5b72c-7294-4368-981d-7e3e213210e1+11:2359:x1873947595494656:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136090.472847:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 25 00000100:00100000:2.0:1787136090.473079:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595494528 00000100:00100000:2.0:1787136090.473085:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595494528 00000100:00100000:2.0:1787136090.473119:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595494784 00000100:00100000:2.0:1787136090.473122:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595494784 00000100:00100000:2.0:1787136090.473132:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595494400 00000100:00100000:2.0:1787136090.473134:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595494400 00000100:00100000:2.0:1787136090.473146:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595494912 00000100:00100000:2.0:1787136090.473148:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595494912 00000100:00100000:2.0:1787136090.473163:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:2.0:1787136090.473171:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98744ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+5:2359:x1873947595494528:12345-192.168.203.38@tcp:400:kworker.0 00000100:00080000:0.0:1787136090.473198:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787136090.473204:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787136090.473211:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98744ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+5:2359:x1873947595494528:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 40us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136090.473219:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:2.0:1787136090.473234:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:2.0:1787136090.473240:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da5b72c-7294-4368-981d-7e3e213210e1+5:2359:x1873947595494784:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787136090.473264:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da5b72c-7294-4368-981d-7e3e213210e1+5:2359:x1873947595494784:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 24us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136090.473271:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:2.0:1787136090.473282:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:2.0:1787136090.473298:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+5:2359:x1873947595494400:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787136090.473323:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+5:2359:x1873947595494400:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 27us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136090.473330:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:2.0:1787136090.473342:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:2.0:1787136090.473348:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da5b72c-7294-4368-981d-7e3e213210e1+5:2359:x1873947595494912:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:2.0:1787136090.473373:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6da5b72c-7294-4368-981d-7e3e213210e1+5:2359:x1873947595494912:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 25us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136090.473379:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:1.0:1787136090.473793:0:14338:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595494144 00000100:00100000:1.0:1787136090.473799:0:14338:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595494144 00000100:00100000:1.0:1787136090.473834:0:14338:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:1.0:1787136090.473842:0:14338:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9852aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:2359:x1873947595494144:12345-192.168.203.38@tcp:400:kworker.0 00000100:00100000:1.0:1787136090.473883:0:14338:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9852aae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b60a4844-c244-49f5-a47a-c4b77f6694b7+13:2359:x1873947595494144:12345-192.168.203.38@tcp:400:kworker.0 Request processed in 43us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136090.473890:0:14338:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 121 00000100:00100000:0.0:1787136090.544293:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136090.544524:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595495168 00000100:00100000:2.0:1787136090.544535:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595495168 00000100:00100000:2.0:1787136090.544600:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:2.0:1787136090.544611:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+19:14472:x1873947595495168:12345-192.168.203.38@tcp:101:cat.0 00010000:00010000:2.0:1787136090.544633:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787136090.544654:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a200/0xf5850c552f203982 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718701 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.544754:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a800/0xf5850c552f203989 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.544768:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a800/0xf5850c552f203989 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.544780:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a800/0xf5850c552f203989 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787136090.544791:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787136090.545333:0:14345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a200/0xf5850c552f203982 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718701 expref: 22 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.545358:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a800/0xf5850c552f203989 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718701 expref: 21 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.545368:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:2.0:1787136090.545371:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787136090.545375:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9876c9a800, rc 0) 00000100:00100000:2.0:1787136090.545446:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+21:14472:x1873947595495168:12345-192.168.203.38@tcp:101:cat.0 Request processed in 837us (1161us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787136090.545454:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 33 00000100:00100000:0.0:1787136090.551234:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136090.551455:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595495424 00000100:00100000:3.0:1787136090.551465:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595495424 00000100:00100000:3.0:1787136090.551517:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:3.0:1787136090.551527:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+21:14472:x1873947595495424:12345-192.168.203.38@tcp:35:cat.0 00000100:00100000:3.0:1787136090.551847:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+22:14472:x1873947595495424:12345-192.168.203.38@tcp:35:cat.0 Request processed in 321us (620us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787136090.551855:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 8 00000100:00100000:3.0:1787136090.558294:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.558521:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595495552 00000100:00100000:1.0:1787136090.558532:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595495552 00000100:00100000:1.0:1787136090.558661:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:1.0:1787136090.558673:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+22:2359:x1873947595495552:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787136090.558688:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787136090.558712:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a800/0xf5850c552f203989 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718701 expref: 22 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.558742:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:1.0:1787136090.558746:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787136090.558800:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+21:2359:x1873947595495552:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 128us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136090.558808:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:1.0:1787136090.616166:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136090.616273:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595495808 00000100:00100000:2.0:1787136090.616284:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595495808 00000100:00100000:2.0:1787136090.616344:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:2.0:1787136090.616355:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+21:14478:x1873947595495808:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1787136090.616376:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787136090.616393:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a200/0xf5850c552f203997 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718708 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.616510:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20399e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.616524:0:14343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20393c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186e5 expref: 22 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.616532:0:14343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186ec expref: 22 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.616569:0:14343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20399e lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.616600:0:14343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186ec expref: 22 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.616613:0:14343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186ec expref: 22 pid: 14345 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136090.616626:0:14343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98769c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14343:1873947616451968:192.168.203.38@tcp:104: 00010000:00010000:2.0:1787136090.616731:0:14343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20393c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186e5 expref: 22 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.616741:0:14343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20393c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186e5 expref: 22 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136090.616750:0:14343:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e98769c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14343:1873947616452096:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787136090.616772:0:14343:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9843317c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787136090.620505:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.620592:0:14330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595495936 00000100:00100000:1.0:1787136090.620602:0:14330:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595495936 00010000:00010000:1.0:1787136090.620642:0:14330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186ec expref: 23 pid: 14345 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136090.620672:0:14343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98769c2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14343:1873947616451968:192.168.203.38@tcp:104: 00000100:00100000:2.0:1787136090.620685:0:14343:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e98769c2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14343:1873947616452096:192.168.203.38@tcp:104: 00000100:00100000:1.0:1787136090.620698:0:14330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:1.0:1787136090.620709:0:14330:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98746c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+23:2359:x1873947595495936:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787136090.620712:0:14343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20399e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.620726:0:14330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787136090.620735:0:14330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186ec expref: 23 pid: 14345 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.620758:0:14330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186ec expref: 23 pid: 14345 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.620780:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ba00/0xf5850c552f203951 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186ec expref: 23 pid: 14345 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.620798:0:14330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:1.0:1787136090.620802:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20399e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.620835:0:14330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20399e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.620842:0:14330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787136090.620897:0:14330:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98746c5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+22:2359:x1873947595495936:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 191us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136090.620905:0:14330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:0.0:1787136090.624914:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136090.627665:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595496064 00000100:00100000:2.0:1787136090.627681:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595496064 00010000:00010000:2.0:1787136090.627739:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20393c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186e5 expref: 22 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136090.627787:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:2.0:1787136090.627796:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+22:2360:x1873947595496064:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787136090.627810:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787136090.627816:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20393c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186e5 expref: 22 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.627828:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20393c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186e5 expref: 22 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.627849:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7a00/0xf5850c552f20393c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b7186e5 expref: 22 pid: 14344 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.627865:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:2.0:1787136090.627870:0:14328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20399e lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.627879:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20399e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.627886:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20399e lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.627917:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787136090.628342:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+21:2360:x1873947595496064:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 546us (3436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136090.628350:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00010000:00010000:0.0:1787136090.628873:0:14343:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20399e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.628882:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20399e lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787136090.628902:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787136090.629228:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a200/0xf5850c552f203997 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718708 expref: 22 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.629244:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9bc00/0xf5850c552f20399e lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718708 expref: 21 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136090.629263:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:0.0:1787136090.629266:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787136090.629269:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9876c9bc00, rc 0) 00000100:00100000:0.0:1787136090.629303:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+21:14478:x1873947595495808:12345-192.168.203.38@tcp:101:dd.0 Request processed in 12951us (13146us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787136090.629309:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 34 00000100:00100000:0.0:1787136090.635261:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.635414:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595496320 00000100:00100000:1.0:1787136090.635423:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595496320 00000100:00100000:1.0:1787136090.635483:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 35 00000100:00100000:1.0:1787136090.635494:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+21:14478:x1873947595496320:12345-192.168.203.38@tcp:36:dd.0 00010000:00010000:1.0:1787136090.635729:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039ac lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.635757:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.635769:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787136090.635815:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787136090.635839:0:14344:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000fdb84503 reply state 00000000ee09fda1 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136090.635848:0:14344:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787136090.635928:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+24:14478:x1873947595496320:12345-192.168.203.38@tcp:36:dd.0 Request processed in 436us (676us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787136090.635936:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 35 00000020:00080000:1.0:1787136090.635941:0:14344:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787136090.638557:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039ac lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.638573:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039ac lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.638580:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.638585:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787136090.638589:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039ac lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.638597:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039ac lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.638612:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:1.0:1787136090.638614:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787136090.638619:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039ac lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.638625:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039ac lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136090.638828:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136090.638881:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595496448 00000100:00100000:2.0:1787136090.638892:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595496448 00000100:00100000:2.0:1787136090.639657:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:2.0:1787136090.639671:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+23:14478:x1873947595496448:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1787136090.639691:0:15677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787136090.639710:0:15677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a600/0xf5850c552f2039b3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71870f expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.639764:0:15677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a600/0xf5850c552f2039b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71870f expref: 24 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.639778:0:15677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a600/0xf5850c552f2039b3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71870f expref: 24 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.639796:0:15677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:2.0:1787136090.639799:0:15677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787136090.639801:0:15677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9876c9a600, rc 0) 00000100:00100000:2.0:1787136090.639866:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+24:14478:x1873947595496448:12345-192.168.203.38@tcp:101:dd.0 Request processed in 199us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136090.639873:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 36 00000100:00100000:3.0:1787136090.651175:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.651246:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595496704 00000100:00100000:1.0:1787136090.651257:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595496704 00000100:00100000:1.0:1787136090.651395:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:1.0:1787136090.651415:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+24:14478:x1873947595496704:12345-192.168.203.38@tcp:103:dd.0 00010000:00010000:1.0:1787136090.651432:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787136090.651518:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a600/0xf5850c552f2039b3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71870f expref: 24 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.651558:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:1.0:1787136090.651563:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787136090.651623:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+23:14478:x1873947595496704:12345-192.168.203.38@tcp:103:dd.0 Request processed in 210us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136090.651630:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:3.0:1787136090.653703:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136090.653946:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595496832 00000100:00100000:2.0:1787136090.653956:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595496832 00000100:00100000:2.0:1787136090.654016:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:2.0:1787136090.654027:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+23:14478:x1873947595496832:12345-192.168.203.38@tcp:58:dd.0 00010000:00010000:2.0:1787136090.654159:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2039ba lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.654176:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2039ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.654200:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2039ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787136090.655427:0:14345:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787136090.655582:0:14345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787136090.655852:0:14345:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787136090.655966:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+23:14478:x1873947595496832:12345-192.168.203.38@tcp:58:dd.0 Request processed in 1937us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136090.655976:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 37 00000100:00100000:3.0:1787136090.658668:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136090.658914:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595496960 00000100:00100000:2.0:1787136090.658923:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595496960 00000100:00100000:2.0:1787136090.658981:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 38 00000100:00100000:2.0:1787136090.658991:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+23:14478:x1873947595496960:12345-192.168.203.38@tcp:101:dd.0 00010000:00010000:2.0:1787136090.659010:0:15677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787136090.659028:0:15677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9b200/0xf5850c552f2039c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718716 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.659128:0:15677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2039ba lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.659139:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9b200/0xf5850c552f2039c1 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718716 expref: 24 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.659160:0:15677:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2039ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.659173:0:15677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9b200/0xf5850c552f2039c1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718716 expref: 24 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.659204:0:15677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:2.0:1787136090.659208:0:15677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787136090.659212:0:15677:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9b200/0xf5850c552f2039c1 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718716 expref: 24 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136090.659220:0:15677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9876c9b200, rc 0) 00000100:00100000:2.0:1787136090.659493:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+24:14478:x1873947595496960:12345-192.168.203.38@tcp:101:dd.0 Request processed in 503us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787136090.659501:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 38 00010000:00010000:1.0:1787136090.712190:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787136090.968389:0:14377:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787136090.968408:0:14377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787136090.968455:0:14377:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787136090.968461:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787136090.968588:0:14377:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e974499dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14377:1873947616452224:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787136090.968688:0:14377:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9741084e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787136090.973897:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.975219:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595497088 00000100:00100000:1.0:1787136090.975233:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595497088 00000100:00100000:0.0:1787136090.975946:0:14377:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e974499dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14377:1873947616452224:192.168.203.38@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787136090.976135:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:1.0:1787136090.976148:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:60a6a922-6d90-4897-b90a-1b9618ede7d7+24:14479:x1873947595497088:12345-192.168.203.38@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787136090.976233:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:60a6a922-6d90-4897-b90a-1b9618ede7d7+24:14479:x1873947595497088:12345-192.168.203.38@tcp:900:lhsmtool_posix.0 Request processed in 89us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136090.976242:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:3.0:1787136090.979010:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.979301:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595497216 00000100:00100000:1.0:1787136090.979312:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595497216 00000100:00100000:1.0:1787136090.979370:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:1.0:1787136090.979380:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+24:14479:x1873947595497216:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787136090.979449:0:14344:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787136090.979553:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+24:14479:x1873947595497216:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 174us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136090.979562:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 39 00000100:00100000:0.0:1787136090.988002:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.988170:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595497344 00000100:00100000:1.0:1787136090.988180:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595497344 00000100:00100000:1.0:1787136090.988234:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:1.0:1787136090.988243:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+24:14479:x1873947595497344:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787136090.988326:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039c8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988342:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988354:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988428:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f2039cf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988437:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f2039cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988443:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f2039cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988463:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2039d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988471:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2039d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988477:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2039d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787136090.988513:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787136090.988517:0:14343:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787136090.988530:0:14343:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2039d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988540:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039c8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988552:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039c8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988558:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988564:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae200 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787136090.988569:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039c8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988577:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039c8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988589:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e98437a7e00) 00010000:00010000:1.0:1787136090.988591:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787136090.988595:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039c8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988601:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae200/0xf5850c552f2039c8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988614:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f2039cf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988620:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f2039cf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988626:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f2039cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988631:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787136090.988638:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f2039cf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988644:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f2039cf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988650:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8e98600eff00) 00010000:00010000:1.0:1787136090.988653:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787136090.988655:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f2039cf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988661:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f2039cf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988674:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2039d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988680:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2039d6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988685:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2039d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988690:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533afc00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787136090.988692:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2039d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988698:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2039d6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988704:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:1.0:1787136090.988706:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787136090.988715:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2039d6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.988720:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533afc00/0xf5850c552f2039d6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136090.988801:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+24:14479:x1873947595497344:12345-192.168.203.38@tcp:34:lhsmtool_posix.0 Request processed in 559us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136090.988810:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 40 00000100:00100000:3.0:1787136090.993277:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136090.993431:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595497600 00000100:00100000:1.0:1787136090.993441:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595497600 00000100:00100000:1.0:1787136090.993505:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:1.0:1787136090.993514:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+24:14479:x1873947595497600:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787136090.993534:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136090.993553:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f2039dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71871d expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.993642:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.993657:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.993668:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787136090.993679:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787136090.993787:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.993795:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.993815:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.993821:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787136090.993826:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.993834:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.993846:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:1.0:1787136090.993850:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787136090.993854:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039e4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.993861:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.994169:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f2039dd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71871d expref: 26 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.994181:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e98437a7e00) 00010000:00010000:1.0:1787136090.994184:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787136090.994188:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f2039dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71871d expref: 26 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136090.994197:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533ae800, rc 0) 00000100:00100000:1.0:1787136090.994256:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+25:14479:x1873947595497600:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 743us (998us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787136090.994273:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 41 00000100:00100000:3.0:1787136091.001880:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136091.002109:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595497728 00000100:00100000:1.0:1787136091.002120:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595497728 00000100:00080000:0.0:1787136091.002228:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787136091.002312:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:1.0:1787136091.002324:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e974499dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+25:14479:x1873947595497728:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787136091.002361:0:14343:0:(mdt_handler.c:8165:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787136091.002504:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e974499dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+25:14479:x1873947595497728:12345-192.168.203.38@tcp:53:lhsmtool_posix.0 Request processed in 182us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136091.002512:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 42 00000100:00100000:0.0:1787136091.007076:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136091.007168:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595497984 00000100:00100000:1.0:1787136091.007177:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595497984 00000100:00100000:1.0:1787136091.007229:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:1.0:1787136091.007238:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+25:14479:x1873947595497984:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787136091.007257:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787136091.007283:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f2039f2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718724 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787136091.007870:0:14344:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1787136091.007877:0:14344:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1787136091.007920:0:14344:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1787136091.008213:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039f9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.008228:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.008239:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039f9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.008298:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae800/0xf5850c552f2039f2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718724 expref: 28 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.008318:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039f9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718724 expref: 27 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.008326:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e98600eff00) 00010000:00010000:1.0:1787136091.008329:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787136091.008332:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e98533ae000, rc 0) 00000100:00100000:1.0:1787136091.008390:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+27:14479:x1873947595497984:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 1152us (1346us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1787136091.008406:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 43 00000100:00100000:3.0:1787136091.028096:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:2.0:1787136091.028554:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595498240 00000100:00100000:2.0:1787136091.028564:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595498240 00000100:00100000:2.0:1787136091.028625:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:2.0:1787136091.028635:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+27:14479:x1873947595498240:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787136091.028698:0:15677:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787136091.028732:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae000/0xf5850c552f2039f9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718724 expref: 27 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028754:0:15677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e98600eff00) 00010000:00010000:2.0:1787136091.028766:0:15677:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787136091.028788:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ac00/0xf5850c552f203a07 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028802:0:15677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ac00/0xf5850c552f203a07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028812:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ac00/0xf5850c552f203a07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028836:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a400/0xf5850c552f203a0e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1417a3fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028843:0:15677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a400/0xf5850c552f203a0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1417a3fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028849:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a400/0xf5850c552f203a0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1417a3fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028938:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ac00/0xf5850c552f203a07 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028946:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ac00/0xf5850c552f203a07 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028953:0:15677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ac00/0xf5850c552f203a07 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028959:0:15677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9ac00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787136091.028964:0:15677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ac00/0xf5850c552f203a07 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028972:0:15677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ac00/0xf5850c552f203a07 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028981:0:15677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e98600efe00) 00010000:00010000:2.0:1787136091.028984:0:15677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787136091.028987:0:15677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ac00/0xf5850c552f203a07 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.028993:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9ac00/0xf5850c552f203a07 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.029010:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a400/0xf5850c552f203a0e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1417a3fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.029016:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a400/0xf5850c552f203a0e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1417a3fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.029022:0:15677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a400/0xf5850c552f203a0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1417a3fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.029027:0:15677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:2.0:1787136091.029030:0:15677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a400/0xf5850c552f203a0e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1417a3fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.029041:0:15677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a400/0xf5850c552f203a0e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x1417a3fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.029089:0:15677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x1417a3fd (ffff8e98820fcc00) 00010000:00010000:2.0:1787136091.029092:0:15677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787136091.029096:0:15677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a400/0xf5850c552f203a0e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1417a3fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.029101:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a400/0xf5850c552f203a0e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x1417a3fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136091.029177:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+26:14479:x1873947595498240:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 543us (1140us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787136091.029184:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 44 00000100:00100000:3.0:1787136091.033826:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136091.038971:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595498368 00000100:00100000:1.0:1787136091.038985:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595498368 00000100:00100000:0.0:1787136091.039668:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:0.0:1787136091.039682:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9881fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+26:14479:x1873947595498368:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787136091.039713:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787136091.039735:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f203a15 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b71872b expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.039770:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f203a1c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.039784:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f203a1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.039796:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f203a1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.040303:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897400/0xf5850c552f203a15 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71872b expref: 28 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.040323:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896000/0xf5850c552f203a1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b71872b expref: 27 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.040332:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:0.0:1787136091.040335:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787136091.040338:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874896000, rc 0) 00000100:00100000:0.0:1787136091.040414:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9881fa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+27:14479:x1873947595498368:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 735us (6595us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136091.040422:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 45 00000100:00100000:2.0:1787136091.045630:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.045692:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595498624 00000100:00100000:3.0:1787136091.045702:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595498624 00000100:00100000:3.0:1787136091.045775:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:3.0:1787136091.045784:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+27:14479:x1873947595498624:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787136091.045864:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203a23 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.045879:0:15677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203a23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.045889:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203a23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787136091.046312:0:15677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1787136091.046323:0:15677:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 450989274698ns, next at 451989272626ns, rc = 0 00000004:00010000:3.0:1787136091.046414:0:15677:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000b971e1ee reply state 000000003df1fb85 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203a23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136091.046423:0:15677:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787136091.046513:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+29:14479:x1873947595498624:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 729us (891us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787136091.046520:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 46 00000100:00100000:2.0:1787136091.051352:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.051448:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595498752 00000100:00100000:3.0:1787136091.051459:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595498752 00000100:00100000:3.0:1787136091.051519:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 47 00000100:00100000:3.0:1787136091.051529:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+29:14479:x1873947595498752:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787136091.051553:0:14345:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136091.051572:0:14345:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203a2a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718732 expref: -99 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.051643:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203a2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718732 expref: 30 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.051656:0:14345:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203a2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718732 expref: 30 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.051778:0:14345:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:3.0:1787136091.051781:0:14345:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787136091.051785:0:14345:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c7000, rc 0) 00000100:00100000:3.0:1787136091.052385:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+30:14479:x1873947595498752:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 853us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136091.052403:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 47 00010000:00010000:0.0:1787136091.052431:0:3287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203a23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.052443:0:3287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203a23 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.052451:0:3287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203a23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.052457:0:3287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c6e00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787136091.052462:0:3287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203a23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.052468:0:3287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203a23 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.052482:0:3287:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:0.0:1787136091.052494:0:3287:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787136091.052499:0:3287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203a23 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.052505:0:3287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c6e00/0xf5850c552f203a23 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15677 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136091.056811:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.056919:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595498880 00000100:00100000:3.0:1787136091.056928:0:15030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595498880 00000100:00100000:3.0:1787136091.056996:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:3.0:1787136091.057006:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+5:2360:x1873947595498880:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787136091.057415:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:2360:x1873947595498880:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 410us (612us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787136091.057424:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 12 00000100:00100000:1.0:1787136091.064590:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.065628:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595499136 00000100:00100000:3.0:1787136091.065640:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595499136 00000100:00100000:3.0:1787136091.065706:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:3.0:1787136091.065716:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+29:14479:x1873947595499136:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787136091.065979:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+30:14479:x1873947595499136:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 263us (1398us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1787136091.065999:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 9 00000100:00100000:0.0:1787136091.071562:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.071666:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595499392 00000100:00100000:3.0:1787136091.071675:0:15677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595499392 00000100:00100000:3.0:1787136091.071774:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:3.0:1787136091.071785:0:15677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+30:14479:x1873947595499392:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787136091.071903:0:15677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+30:14479:x1873947595499392:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 120us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136091.071911:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 48 00000100:00100000:1.0:1787136091.076461:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136091.076571:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595499520 00000100:00100000:0.0:1787136091.076581:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595499520 00000100:00100000:0.0:1787136091.076673:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:0.0:1787136091.076682:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987420dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+30:14479:x1873947595499520:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787136091.076702:0:14344:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787136091.076721:0:14344:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a31 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718739 expref: -99 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.076794:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a38 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.076823:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.076836:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787136091.076869:0:14344:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787136091.076887:0:14344:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a38 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.076912:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a31 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718739 expref: 32 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.076944:0:14344:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a38 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718739 expref: 31 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.076952:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:0.0:1787136091.076955:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787136091.076958:0:14344:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e9874897600, rc 0) 00000100:00100000:0.0:1787136091.077017:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987420dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+31:14479:x1873947595499520:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 336us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1787136091.077025:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 49 00000100:00100000:2.0:1787136091.080783:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.081015:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595499648 00000100:00100000:3.0:1787136091.081026:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595499648 00000100:00100000:3.0:1787136091.081124:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:3.0:1787136091.081134:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+6:2360:x1873947595499648:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787136091.081153:0:15029:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787136091.081174:0:15029:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082d38c94/0xf5850c552f203a3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x2eee43441b718740 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787136091.081199:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a85885b, blocks: 0x1 00010000:00010000:3.0:1787136091.081220:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=451s v=(0 0) 00010000:00010000:3.0:1787136091.081225:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787136091.081234:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082d38c94/0xf5850c552f203a3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718740 expref: 7 pid: 15029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.081252:0:15029:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082d38c94/0xf5850c552f203a3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718740 expref: 7 pid: 15029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.081278:0:15029:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e987c2c6c00, rc 0) 00000100:00100000:3.0:1787136091.081335:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+7:2360:x1873947595499648:12345-192.168.203.38@tcp:101:lhsmtool_posix.0 Request processed in 202us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136091.081342:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:2.0:1787136091.085267:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136091.085430:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595499904 00000100:00100000:1.0:1787136091.085439:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595499904 00000100:00100000:1.0:1787136091.085502:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:1.0:1787136091.085512:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+31:14479:x1873947595499904:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787136091.085616:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+31:14479:x1873947595499904:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 105us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136091.085624:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 50 00000100:00100000:2.0:1787136091.088435:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.088522:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595500032 00000100:00100000:3.0:1787136091.088532:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595500032 00000100:00100000:3.0:1787136091.088623:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:3.0:1787136091.088634:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+31:14479:x1873947595500032:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787136091.132959:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:0.0:1787136091.132984:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:0.0:1787136091.132999:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1787136091.133032:0:5844:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1787136091.133039:0:5844:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1787136091.133197:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616452352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787136091.133258:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136091.133330:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616452352 00000100:00100000:0.0:1787136091.133337:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616452352 00000100:00100000:0.0:1787136091.133465:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787136091.133475:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616452352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787136091.133613:0:15027:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787136091.133617:0:15027:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787136091.133619:0:15027:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787136091.133621:0:15027:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787136091 -> 1787136091 00002000:00010000:0.0:1787136091.133624:0:15027:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787136091.133663:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3300:x1873947616452352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 190us (404us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787136091.133683:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1787136091.133708:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1787136091.133736:0:3300:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e987c18e300/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787136091.133753:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616452352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787136091.134295:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+14:14479:x1873947595500032:12345-192.168.203.38@tcp:44:lhsmtool_posix.0 Request processed in 45660us (45867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136091.134303:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 51 00000100:00100000:2.0:1787136091.141288:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.141455:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595500160 00000100:00100000:3.0:1787136091.141465:0:15030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595500160 00000100:00100000:3.0:1787136091.141563:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:3.0:1787136091.141574:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+7:2359:x1873947595500160:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787136091.141681:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+7:2359:x1873947595500160:12345-192.168.203.38@tcp:16:lhsmtool_posix.0 Request processed in 108us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136091.141689:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 15 00000100:00100000:2.0:1787136091.144349:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136091.144511:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595500416 00000100:00100000:1.0:1787136091.144521:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595500416 00000100:00100000:1.0:1787136091.144609:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:1.0:1787136091.144641:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+14:14479:x1873947595500416:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787136091.145494:0:14343:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787136091.145525:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a38 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718739 expref: 14 pid: 14344 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.145544:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:1.0:1787136091.145549:0:14343:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787136091.145578:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f203a46 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.145593:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f203a46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.145603:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f203a46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787136091.146000:0:14343:0:(mdt_handler.c:4673:mdt_save_lock()) ### save lock request 00000000e8d0426c reply state 00000000ac721c7d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f203a46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136091.146010:0:14343:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787136091.146409:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+15:14479:x1873947595500416:12345-192.168.203.38@tcp:36:lhsmtool_posix.0 Request processed in 1754us (2052us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787136091.146418:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 52 00000100:00100000:2.0:1787136091.149094:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.149302:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595500544 00000100:00100000:3.0:1787136091.149311:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595500544 00000100:00100000:3.0:1787136091.149361:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:3.0:1787136091.149451:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+7:2360:x1873947595500544:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787136091.149642:0:15029:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1787136091.149654:0:15029:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787136090 00002000:00010000:3.0:1787136091.149657:0:15029:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787136090 00002000:00010000:3.0:1787136091.149659:0:15029:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787136091 -> 1787136090 00002000:00010000:3.0:1787136091.149661:0:15029:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787136091.149711:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+8:2360:x1873947595500544:12345-192.168.203.38@tcp:2:lhsmtool_posix.0 Request processed in 340us (631us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787136091.149719:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 16 00000100:00100000:0.0:1787136091.152131:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.152242:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595500672 00000100:00100000:3.0:1787136091.152252:0:15030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595500672 00000100:00100000:3.0:1787136091.152302:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 17 00000100:00100000:3.0:1787136091.152312:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+8:2359:x1873947595500672:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787136091.152350:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4f3e3a9/0xf5850c552f203a4d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.152438:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787136091.152443:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787136091.152450:0:15030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f3e3a9/0xf5850c552f203a4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.152465:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4f3e3a9/0xf5850c552f203a4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.152491:0:15030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4f3e3a9/0xf5850c552f203a4d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.152500:0:15030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4f3e3a9/0xf5850c552f203a4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.152526:0:15030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4f3e3a9/0xf5850c552f203a4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.152534:0:15030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136091.152539:0:15030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f3e3a9/0xf5850c552f203a4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.152549:0:15030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4f3e3a9/0xf5850c552f203a4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.152565:0:15030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4f3e3a9/0xf5850c552f203a4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.152574:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4f3e3a9/0xf5850c552f203a4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136091.152714:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:60a6a922-6d90-4897-b90a-1b9618ede7d7+8:2359:x1873947595500672:12345-192.168.203.38@tcp:1:lhsmtool_posix.0 Request processed in 403us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136091.152723:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 17 00010000:00010000:1.0:1787136091.152820:0:3286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f203a46 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.152828:0:3286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f203a46 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.152834:0:3286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f203a46 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.152847:0:3286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae400 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:1.0:1787136091.152851:0:3286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f203a46 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.152857:0:3286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f203a46 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.152868:0:3286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:1.0:1787136091.152871:0:3286:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787136091.152875:0:3286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f203a46 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.152881:0:3286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e98533ae400/0xf5850c552f203a46 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136091.155317:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136091.155610:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595500928 00000100:00100000:0.0:1787136091.155619:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595500928 00000100:00100000:0.0:1787136091.155701:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 53 00000100:00100000:0.0:1787136091.155711:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+14:14479:x1873947595500928:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787136091.155798:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a54 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.155817:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.155828:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.156911:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.156932:0:14344:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203a2a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718732 expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.156940:0:14344:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.156975:0:14344:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203a2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718732 expref: 15 pid: 14345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.157003:0:14344:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203a2a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718732 expref: 15 pid: 14345 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136091.157017:0:14344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14344:1873947616452480:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787136091.159490:0:14344:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ade40 going to sleep for 11 seconds 00000100:00100000:2.0:1787136091.163562:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136091.163674:0:14344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14344:1873947616452480:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787136091.163699:0:14344:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136091.163844:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595501056 00000100:00100000:3.0:1787136091.163850:0:14328:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595501056 00010000:00010000:3.0:1787136091.163886:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203a2a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718732 expref: 16 pid: 14345 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136091.163951:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 13 00000100:00100000:3.0:1787136091.163973:0:14328:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+16:2360:x1873947595501056:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787136091.163987:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787136091.163995:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203a2a lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718732 expref: 16 pid: 14345 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.164007:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203a2a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718732 expref: 16 pid: 14345 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.164029:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e987c2c7000/0xf5850c552f203a2a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718732 expref: 16 pid: 14345 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.164044:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:3.0:1787136091.164079:0:14328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.164193:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.164203:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.164231:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787136091.164316:0:14328:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+15:2360:x1873947595501056:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 344us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136091.164324:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 13 00010000:00010000:0.0:1787136091.164380:0:14344:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.164388:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787136091.164599:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787136091.164734:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787136091.164797:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787136091.164870:0:14344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14344:1873947616452608:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787136091.164940:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136091.164970:0:14344:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98607ad900 going to sleep for 11 seconds 00000100:00100000:1.0:1787136091.165620:0:14348:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616452608 00000100:00100000:1.0:1787136091.165627:0:14348:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616452608 00000100:00100000:1.0:1787136091.165661:0:14348:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787136091.165669:0:14348:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14344:x1873947616452608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787136091.165759:0:14348:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14344:x1873947616452608:12345-0@lo:1000:mdt00_001.0 Request processed in 91us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136091.166026:0:14348:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787136091.166197:0:14344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18e680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14344:1873947616452608:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787136091.168535:0:14344:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787136091.168627:0:14344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c18ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14344:1873947616452736:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787136091.168685:0:14344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787136091.168758:0:14344:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e98606f2000 going to sleep for 11 seconds 00000100:00100000:2.0:1787136091.168824:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616452736 00000100:00100000:2.0:1787136091.168831:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616452736 00000100:00100000:2.0:1787136091.168910:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787136091.168919:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14344:x1873947616452736:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787136091.169118:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14344:x1873947616452736:12345-0@lo:1000:mdt00_001.0 Request processed in 201us (432us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787136091.169127:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787136091.169204:0:14344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c18ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14344:1873947616452736:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1787136091.169248:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169257:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169265:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169271:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896a00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787136091.169275:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169282:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169297:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:0.0:1787136091.169300:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787136091.169304:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169311:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896a00/0xf5850c552f203a5b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169338:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2039ba lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169345:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2039ba lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169351:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2039ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169367:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a000 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787136091.169371:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2039ba lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169377:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2039ba lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169386:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:0.0:1787136091.169389:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787136091.169405:0:14344:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9b200/0xf5850c552f2039c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718716 expref: 18 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169416:0:14344:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9b200/0xf5850c552f2039c1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718716 expref: 18 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169424:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9b200/0xf5850c552f2039c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718716 expref: 18 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.169452:0:14344:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9b200/0xf5850c552f2039c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718716 expref: 18 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136091.169463:0:14344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14344:1873947616452864:192.168.203.38@tcp:105: 00000100:00100000:0.0:1787136091.169526:0:14344:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9852b19840 going to sleep for 11 seconds 00000100:00100000:3.0:1787136091.171894:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.171923:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595501184 00000100:00100000:3.0:1787136091.171930:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595501184 00000100:00100000:3.0:1787136091.171989:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:3.0:1787136091.172011:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9744a50450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+19:14478:x1873947595501184:12345-192.168.203.38@tcp:49:dd.0 00000100:00100000:3.0:1787136091.172157:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9744a50450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+19:14478:x1873947595501184:12345-192.168.203.38@tcp:49:dd.0 Request processed in 146us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136091.172165:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 10 00000100:00100000:0.0:1787136091.173018:0:14344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14344:1873947616452864:192.168.203.38@tcp:105: 00010000:00010000:0.0:1787136091.173071:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2039ba lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173230:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f2039ba lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173262:0:14344:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896c00/0xf5850c552f203a62 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173276:0:14344:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896c00/0xf5850c552f203a62 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173286:0:14344:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896c00/0xf5850c552f203a62 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173295:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896c00/0xf5850c552f203a62 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173301:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896c00/0xf5850c552f203a62 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173308:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896c00/0xf5850c552f203a62 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173313:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896c00 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787136091.173317:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896c00/0xf5850c552f203a62 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173323:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896c00/0xf5850c552f203a62 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173332:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:0.0:1787136091.173335:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787136091.173338:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896c00/0xf5850c552f203a62 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173350:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874896c00/0xf5850c552f203a62 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173359:0:14344:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173366:0:14344:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a54 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173371:0:14344:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173377:0:14344:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897600 already unused, calling callback (ffffffffc20304f0) 00010000:00010000:0.0:1787136091.173380:0:14344:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173385:0:14344:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a54 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173402:0:14344:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e98437a7800) 00010000:00010000:0.0:1787136091.173404:0:14344:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787136091.173407:0:14344:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a54 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.173413:0:14344:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9874897600/0xf5850c552f203a54 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14344 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136091.173721:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+18:14479:x1873947595500928:12345-192.168.203.38@tcp:57:lhsmtool_posix.0 Request processed in 18010us (18409us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787136091.173731:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 53 00000020:00080000:0.0:1787136091.173742:0:14344:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787136091.180796:0:14377:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787136091.180806:0:14377:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787136091.180839:0:14377:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787136091.180845:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787136091.183003:0:3294:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.185850:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595501440 00000100:00100000:3.0:1787136091.185864:0:14346:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595501440 00000100:00100000:3.0:1787136091.185921:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 11 00000100:00100000:3.0:1787136091.185930:0:14346:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9842aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+18:14479:x1873947595501440:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787136091.192329:0:14346:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787136091.192445:0:14346:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787136091.192506:0:14346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f203a69 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.192522:0:14346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f203a69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.192533:0:14346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f203a69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.192541:0:14346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f203a69 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.192555:0:14346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f203a69 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.192561:0:14346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f203a69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.192577:0:14346:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787136091.192680:0:14346:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9842aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+20:14479:x1873947595501440:12345-192.168.203.38@tcp:35:lhsmtool_posix.0 Request processed in 6746us (9747us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787136091.192693:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 11 00000020:00080000:2.0:1787136091.192699:0:14346:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787136091.192816:0:14332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787136091.192823:0:14332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f203a69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.192831:0:14332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9a000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:0.0:1787136091.192835:0:14332:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f203a69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.192843:0:14332:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f203a69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.192856:0:14332:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e98494a1c00) 00010000:00010000:0.0:1787136091.192859:0:14332:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787136091.192864:0:14332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f203a69 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.192869:0:14332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e9876c9a000/0xf5850c552f203a69 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14346 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.192882:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136091.192884:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787136091.192886:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787136091.300245:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136091.300460:0:15033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595501568 00000100:00100000:0.0:1787136091.300470:0:15033:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595501568 00000100:00100000:0.0:1787136091.300536:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:0.0:1787136091.300547:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+8:2360:x1873947595501568:12345-192.168.203.38@tcp:4:dd.0 00010000:00010000:0.0:1787136091.300582:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.300621:0:15033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082d38c94/0xf5850c552f203a3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.38@tcp remote: 0x2eee43441b718740 expref: 8 pid: 15029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.300630:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787136091.300634:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787136091.300649:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.300687:0:15033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082d38c94/0xf5850c552f203a3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718740 expref: 8 pid: 15029 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.300703:0:15033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082d38c94/0xf5850c552f203a3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718740 expref: 8 pid: 15029 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787136091.300718:0:15033:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e9842aaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15033:1873947616452992:192.168.203.38@tcp:104: 00000100:00100000:0.0:1787136091.301019:0:15033:0:(client.c:2702:ptlrpc_set_wait()) set ffff8e9852b19840 going to sleep for 11 seconds 00000100:00100000:0.0:1787136091.303266:0:15033:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e9842aaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15033:1873947616452992:192.168.203.38@tcp:104: 00010000:00010000:0.0:1787136091.303292:0:15033:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136091.304166:0:3293:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136091.304528:0:14329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595501696 00000100:00100000:1.0:1787136091.304537:0:14329:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595501696 00010000:00010000:1.0:1787136091.304573:0:14329:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082d38c94/0xf5850c552f203a3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718740 expref: 9 pid: 15029 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136091.304636:0:14329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 14 00000100:00100000:1.0:1787136091.304646:0:14329:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+9:2360:x1873947595501696:12345-192.168.203.38@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787136091.304661:0:14329:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787136091.304684:0:14329:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082d38c94/0xf5850c552f203a3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718740 expref: 9 pid: 15029 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.304697:0:14329:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082d38c94/0xf5850c552f203a3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718740 expref: 9 pid: 15029 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.304719:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082d38c94/0xf5850c552f203a3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.38@tcp remote: 0x2eee43441b718740 expref: 9 pid: 15029 timeout: 551 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.304735:0:14329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136091.304740:0:14329:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136091.304756:0:14329:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.304764:0:14329:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.304794:0:14329:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787136091.304858:0:14329:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:60a6a922-6d90-4897-b90a-1b9618ede7d7+8:2360:x1873947595501696:12345-192.168.203.38@tcp:103:ldlm_bl.0 Request processed in 213us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1787136091.304866:0:14329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 14 00010000:00010000:0.0:1787136091.305096:0:15033:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.305106:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136091.316357:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.316432:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.316876:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136091.321790:0:15034:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787136091.321933:0:15035:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787136091.322472:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136091.324171:0:15034:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787136091.324387:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595501824 00000100:00100000:0.0:1787136091.324404:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595501824 00000100:00100000:0.0:1787136091.324457:0:15035:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787136091.324464:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595501952 00000100:00100000:0.0:1787136091.324467:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595501952 00000100:00100000:0.0:1787136091.324481:0:15035:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787136091.324486:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595502080 00000100:00100000:0.0:1787136091.324488:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595502080 00000100:00100000:1.0:1787136091.325358:0:16573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:1.0:1787136091.325373:0:16573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+11:2359:x1873947595501824:12345-192.168.203.38@tcp:4:dd.0 00010000:00010000:1.0:1787136091.325423:0:16573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203a77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.325440:0:16573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136091.325445:0:16573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136091.325451:0:16573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203a77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.325466:0:16573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203a77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136091.326709:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:0.0:1787136091.329763:0:15035:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787136091.329783:0:15035:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1787136091.329920:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595502208 00000100:00100000:0.0:1787136091.329931:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595502208 00000100:00100000:0.0:1787136091.329983:0:15035:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1787136091.329990:0:15035:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595502336 00000100:00100000:0.0:1787136091.329994:0:15035:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595502336 00000100:00100000:0.0:1787136091.330636:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:0.0:1787136091.330649:0:16574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60a6a922-6d90-4897-b90a-1b9618ede7d7+13:2359:x1873947595501952:12345-192.168.203.38@tcp:4:dd.0 00010000:00010000:0.0:1787136091.330688:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eee41f75/0xf5850c552f203a7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.330706:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787136091.330711:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787136091.330717:0:16574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eee41f75/0xf5850c552f203a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787136091.330731:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eee41f75/0xf5850c552f203a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136091.342017:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:1.0:1787136091.343520:0:15035:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1787136091.343538:0:15035:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1787136091.343914:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.38@tcp (source: 12345-192.168.203.38@tcp) 00000100:00100000:3.0:1787136091.343951:0:15034:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787136091.343958:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595502464 00000100:00100000:3.0:1787136091.343967:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595502464 00000100:00100000:3.0:1787136091.344014:0:15034:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787136091.344020:0:15034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947595502592 00000100:00100000:3.0:1787136091.344023:0:15034:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947595502592 00000100:00100000:1.0:1787136091.352954:0:16575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:1.0:1787136091.352972:0:16575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e9876bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:60a6a922-6d90-4897-b90a-1b9618ede7d7+17:2359:x1873947595502080:12345-192.168.203.38@tcp:4:dd.0 00010000:00010000:1.0:1787136091.353015:0:16575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f203a85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.353033:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136091.353037:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136091.353044:0:16575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f203a85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.353098:0:16575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f203a85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787136091.420019:0:15033:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1787136091.420027:0:15033:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787136090 -> 1787136091 00002000:00010000:2.0:1787136091.420030:0:15033:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787136090 -> 1787136091 00002000:00010000:2.0:1787136091.420033:0:15033:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1787136091.420068:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.420082:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.420262:0:15033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.420346:0:16573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203a77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.420357:0:16573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203a77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.420383:0:16573:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203a77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.420401:0:16573:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae400 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:3.0:1787136091.420407:0:16573:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203a77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.420417:0:16573:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203a77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.420438:0:16573:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203a77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.420448:0:16573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000841d03a/0xf5850c552f203a77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787136091.420571:0:16573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+25:2359:x1873947595501824:12345-192.168.203.38@tcp:4:dd.0 Request processed in 95197us (104218us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787136091.420581:0:16573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 1 00000100:00100000:3.0:1787136091.420612:0:16573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 4 00000100:00100000:3.0:1787136091.420623:0:16573:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+24:2359:x1873947595502208:12345-192.168.203.38@tcp:4:dd.0 00010000:00010000:3.0:1787136091.420654:0:16573:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013694221/0xf5850c552f203a8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.420667:0:16573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787136091.420676:0:16573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787136091.420683:0:16573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013694221/0xf5850c552f203a8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787136091.420695:0:16573:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013694221/0xf5850c552f203a8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.420868:0:15033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874897600 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136091.420873:0:15033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.420893:0:15033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.420905:0:15033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.420912:0:15033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f31d0f05/0xf5850c552f203a70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136091.420945:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c18c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+23:2360:x1873947595501568:12345-192.168.203.38@tcp:4:dd.0 Request processed in 120401us (120709us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787136091.420956:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 0 00000100:00100000:2.0:1787136091.420972:0:15033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 5 00000100:00100000:2.0:1787136091.420978:0:15033:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+22:2360:x1873947595502336:12345-192.168.203.38@tcp:4:dd.0 00010000:00010000:2.0:1787136091.420993:0:15033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f203a93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.421002:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136091.421005:0:15033:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136091.421009:0:15033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f203a93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.421018:0:15033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f203a93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787136091.421181:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1787136091.421193:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:2.0:1787136091.421200:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1787136091.421205:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1787136091.476781:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000001:00080000:2.0:1787136091.476803:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1787136091.476872:0:16574:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:2.0:1787136091.476878:0:16574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:2.0:1787136091.476903:0:16574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eee41f75/0xf5850c552f203a7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.476917:0:16574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eee41f75/0xf5850c552f203a7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.476927:0:16574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eee41f75/0xf5850c552f203a7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.476934:0:16574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9874896c00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136091.476938:0:16574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eee41f75/0xf5850c552f203a7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.476947:0:16574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eee41f75/0xf5850c552f203a7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.476967:0:16574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eee41f75/0xf5850c552f203a7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.476992:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eee41f75/0xf5850c552f203a7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136091.477114:0:16574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60a6a922-6d90-4897-b90a-1b9618ede7d7+17:2359:x1873947595501952:12345-192.168.203.38@tcp:4:dd.0 Request processed in 146463us (160677us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787136091.477124:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 2 00000100:00100000:2.0:1787136091.477155:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 6 00000100:00100000:2.0:1787136091.477167:0:16574:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60a6a922-6d90-4897-b90a-1b9618ede7d7+16:2359:x1873947595502464:12345-192.168.203.38@tcp:4:dd.0 00010000:00010000:2.0:1787136091.477198:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d0f55c/0xf5850c552f203a9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.477210:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136091.477214:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787136091.477220:0:16574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078d0f55c/0xf5850c552f203a9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.477233:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078d0f55c/0xf5850c552f203a9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.482487:0:16575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f203a85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.482508:0:16575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f203a85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.482518:0:16575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f203a85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.482526:0:16575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae200 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136091.482531:0:16575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f203a85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.482541:0:16575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f203a85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.482562:0:16575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f203a85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.482570:0:16575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e96bbff5/0xf5850c552f203a85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136091.482658:0:16575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e9876bd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:60a6a922-6d90-4897-b90a-1b9618ede7d7+16:2359:x1873947595502080:12345-192.168.203.38@tcp:4:dd.0 Request processed in 129687us (165777us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787136091.482667:0:16575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 3 00000100:00100000:1.0:1787136091.482705:0:16575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.38@tcp, seq: 7 00000100:00100000:1.0:1787136091.482717:0:16575:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e987c4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:60a6a922-6d90-4897-b90a-1b9618ede7d7+15:2359:x1873947595502592:12345-192.168.203.38@tcp:4:dd.0 00010000:00010000:1.0:1787136091.482759:0:16575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203aa1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.482771:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136091.482775:0:16575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787136091.482782:0:16575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203aa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.482794:0:16575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203aa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787136091.531150:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1787136091.531217:0:16573:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1787136091.531222:0:16573:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:2.0:1787136091.531239:0:16573:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013694221/0xf5850c552f203a8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.531272:0:16573:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013694221/0xf5850c552f203a8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.531280:0:16573:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013694221/0xf5850c552f203a8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.531287:0:16573:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e987c2c7000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136091.531292:0:16573:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013694221/0xf5850c552f203a8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.531302:0:16573:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013694221/0xf5850c552f203a8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.531323:0:16573:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013694221/0xf5850c552f203a8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.531332:0:16573:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013694221/0xf5850c552f203a8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136091.531440:0:16573:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:60a6a922-6d90-4897-b90a-1b9618ede7d7+15:2359:x1873947595502208:12345-192.168.203.38@tcp:4:dd.0 Request processed in 110816us (208967us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787136091.531450:0:16573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 4 00010000:00010000:1.0:1787136091.531920:0:15033:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f203a93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.531931:0:15033:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f203a93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.531938:0:15033:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f203a93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.531944:0:15033:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9aa00 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136091.531948:0:15033:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f203a93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.531955:0:15033:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f203a93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.531980:0:15033:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f203a93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.531987:0:15033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfcae1b9/0xf5850c552f203a93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136091.532031:0:15033:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:60a6a922-6d90-4897-b90a-1b9618ede7d7+13:2360:x1873947595502336:12345-192.168.203.38@tcp:4:dd.0 Request processed in 111051us (205325us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787136091.532038:0:15033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 5 00000001:00080000:3.0:1787136091.567118:0:6697:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:2.0:1787136091.567271:0:16574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1787136091.567292:0:16574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d0f55c/0xf5850c552f203a9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.567325:0:16574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078d0f55c/0xf5850c552f203a9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.567334:0:16574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078d0f55c/0xf5850c552f203a9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.567340:0:16574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e9876c9b800 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:2.0:1787136091.567345:0:16574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d0f55c/0xf5850c552f203a9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.567355:0:16574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d0f55c/0xf5850c552f203a9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.567377:0:16574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078d0f55c/0xf5850c552f203a9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787136091.567384:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078d0f55c/0xf5850c552f203a9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787136091.567488:0:16574:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:60a6a922-6d90-4897-b90a-1b9618ede7d7+7:2359:x1873947595502464:12345-192.168.203.38@tcp:4:dd.0 Request processed in 90321us (240745us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787136091.567497:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 6 00010000:00010000:1.0:1787136091.570298:0:16575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203aa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.570320:0:16575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203aa1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.570330:0:16575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203aa1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.570339:0:16575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e98533ae000 already unused, calling callback (ffffffffc15cb390) 00010000:00010000:1.0:1787136091.570344:0:16575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203aa1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.570363:0:16575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203aa1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.570406:0:16575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203aa1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787136091.570416:0:16575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ee23602/0xf5850c552f203aa1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787136091.570519:0:16575:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e987c4c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:60a6a922-6d90-4897-b90a-1b9618ede7d7+5:2359:x1873947595502592:12345-192.168.203.38@tcp:4:dd.0 Request processed in 87801us (226604us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787136091.570528:0:16575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.38@tcp, seq: 7 00010000:00010000:3.0:1787136091.736296:0:15684:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787136092.761139:0:14331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787136092.990445:0:16612:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1787136093.144426:0:3300:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787136093.144461:0:3300:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff8e987c4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616453120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787136093.144528:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787136093.144621:0:15032:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1873947616453120 00000100:00100000:3.0:1787136093.144629:0:15032:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1873947616453120 00000100:00100000:3.0:1787136093.144697:0:15032:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787136093.144707:0:15032:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e98769c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616453120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787136093.144745:0:15032:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1787136093.144796:0:15032:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e98769c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3300:x1873947616453120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1787136093.144804:0:15032:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787136093.144843:0:3300:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1787136093.144849:0:3300:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e987c18e300, transno 8589934595 00000004:00080000:3.0:1787136093.144859:0:3300:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1787136093.144885:0:3300:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff8e987c4c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3300:1873947616453120:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787136093.145093:0:14339:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787136093.784262:0:14332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29187 lines, 29187 kept, 0 dropped, 0 bad.